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ABSTRACT 


The  purpose  of  this  study  was  to  gather  information  that 
could  be  used  as  a  basis  for  evaluating  the  relative  effective¬ 
ness  of  two  methods  of  teaching  logarithms  to  students  registered 
in  Mathematics  20. 

In  April,  1965,  the  Cooperative  Intermediate  Algebra 
(Quadratics  and  Beyond)  Test ,  Form  Y  was  administered  to  ten 
classes  of  Mathematics  20  students  in  the  Edmonton  (RC)  Separate 
School  system.  Using  a  method  of  random  selection,  five  classes 
were  taught  logarithms  in  the  conventional  classroom  manner  and  the 
other  classes  were  taught  by  the  method  of  programmed  instruction. 
When  the  unit  of  work  was  completed  the  Cooperative  Intermediate 
Algebra  (Quadratics  and  Beyond)  Test ,  Form  Z_  was  administered  to 
all  the  classes.  Three  weeks  later  a  test  on  logarithms  to  measure 
retention  was  administered  to  all  the  classes.  Using  Total  SCAT 
scores,  available  from  the  Department  of  Education  grade  IX  records, 
the  students  were  subdivided  into  two  categories.  Two-way  analysis 
of  variance  was  carried  out  on  the  data  to  test  the  null  hypotheses. 
Also,  the  students  were  subdivided  into  two  categories  on  the  basis 
of  the  SCAT  Verbal  scores,  available  from  the  Department  of  Education 
grade  IX  records,  and  a  two-way  analysis  of  variance  was  carried  out 
on  the  data  to  test  the  null  hypotheses. 

On  the  basis  of  the  analysis  the  following  conclusions, 
within  the  limitations  of  this  study,  were  made. 
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The  programmed  booklets  provided  a  means  of  instruction 
which  was  as  effective  as  the  conventional  method  of  teaching. 


111 


After  a  lapse  of  three  weeks,  students  taught  by  pro¬ 
grammed  instruction,  retained  as  much  knowledge  of  logarithms  as 
students  taught  by  the  conventional  classroom  method. 

The  experiment  provided  validation  of  the  programmed 
booklets  as  a  method  of  instruction  for  the  material  which  they 
covered. 
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CHAPTER  I 


THE  NATURE  AND  SIGNIFICANCE  OF  THE  PROBLEM 

I.  INTRODUCTION 


The  quickening  pace  of  technological  change  and  the  tre¬ 
mendous  population  explosion  are  placing  increasing  demands  on 
education.  As  Jenkinson  asserts: 

Though  change  is  perhaps  "the  blight  man  was  born  for"  it 
must  be  acknowledged  that  change  has  been  accelerated  and 
gives  no  indication  of  early  abatement.  So  many  of  our  old 
problems  are  still  with  us.  So  tfiany  areas  of  knowledge  are 
as  yet  incomplete.  It  has  been  long  realized  that  provisions 
must  be  made  for  individual  differences,  but  while  many  are 
undertaking  experiments  in  this  area  the  full  implication  of 
each  adaption  of  method  or  administration  has  not  always  been 
realized.  ^ 

Coutts  in  a  message  addressed  to  the  teachers  of  Alberta 


states : 

Knowledge  —  both  academic  and  professional  —  continues  to 
expand  at  an  unprecedented  rate.  Hence  professional  groups 
are  faced  with  the  task  of  keeping  informed  about  new  con¬ 
cepts  and  improved  procedures. 

These  problems  have  created  a  climate  in  which  the  national 

spotlight  is  now  focussed  on  education.  Both  business  and  government 


^Marion  D.  Jenkinson,  "Some  Implications  of  Psychological 
Research  for  Elementary  Education"  Canadian  Education  and  Research 
Digest ,  C.  Warrington  (ed) .  (Toronto:  Canadian  Education  Associa¬ 
tion,  Vol.  2,  Number  3,  1962),  p.  195. 


2 

Herbert  T.  Coutts,  Dean,  Faculty  of  Education,  University 
of  Alberta,  Pamphlet  Summer  ' 67 ,  Continuing  Professional  Education 
for  Teachers  (Faculty  of  Education,  Department  of  Extension,  Univer¬ 
sity  of  Alberta.) 
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are  watching  to  see  how  the  educational  establishment  adapts 
existing  patterns  of  instruction  to  the  changing  realities  of 
the  present  and  future. 

Jack  E.  Forbes,  Chairman  of  the  Department  of  Mathematics, 

Purdue  University  and  Director  of  Research  at  the  Britannica 

Centre  for  Studies  in  Learning  stated: 

In  today’s  world  of  exploding  knowledge  it  is  necessary  to 
capitalize  on  every  method  of  communicating  information  and 
ideas . 3 


II.  BACKGROUND  OF  THE  PROBLEM 

If  education  is  to  meet  the  challenge  of  increasing  the 
efficiency  and  effectiveness  of  the  instructional  process,  teachers 
must  be  given  more  opportunity  to  make  optimum  use  of  their  teach¬ 
ing  time.  A  primary  objective  of  educational  technology  must  be  to 
develop  instructional  media  which  will  help  to  maximize  the  effec¬ 
tive  use  of  teacher  time.  Experimentation  and  innovation  in  this 
area  are  widespread  and  the  pace  is  accelerating.  As  a  result,  new 
types  of  instructional  aids  are  being  developed,  one  of  which  is 
programmed  instruction. 

III.  THE  PROBLEM 

The  purpose  of  thi9  study  was  to  compare  experimentally  the 
effectiveness  of  programmed  instruction  used  during  class  time  with 

3 

Stated  in  an  address  to  teachers  attending  a  seminar  in  pro¬ 
grammed  instruction  in  Edmonton  during  the  summer  of  1964. 
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that  of  the  conventional  method  of  teaching  logarithms.  Do 
students  using  programmed  instructional  materials  only,  develop 
as  much  understanding  of  the  mathematical  concepts  as  do  students 
taught  in  the  conventional  manner? 

How  do  students  learning  with  programmed  instructional 
materials  only,  compare  with  students  taught  in  the  traditional 
manner  with  respect  to  achievement  as  measured  by  a  standardized 
mathematics  test?  Do  students  using  programmed  instructional 
materials  only,  retain  as  much  knowledge  of  the  mathematical  con¬ 
cepts  as  do  students  taught  in  the  conventional  manner  as  measured 
by  a  conventional  set  of  exercises,  administered  three  weeks  after 
completion  of  the  unit  study?  This  investigation  was  an  attempt 
to  gather  objective  evidence  that  might  suggest  answers  to  these 
questions . 

IV.  THE  EXPERIMENTAL  SETTING 

The  study  was  conducted  during  the  spring  of  1965  in  the 
high  schools  of  the  Edmonton  Separate  School  system.  Five  teachers 
participated  in  the  study  and  each  taught  Mathematics  20  to  two 
classes  of  students.  These  teachers  did  not  indicate  any  pronounced 
bias  for  any  particular  method  of  teaching  logarithms.  They  had 
similar  backgrounds  in  teacher  training,  specialization  and  in 
teaching  experience.  All  indicated  a  willingness  to  participate 


in  this  study. 


» 
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A  method  of  random  selection  was  used  to  determine  which 
of  the  two  classes  in  each  school  would  be  taught  in  the  conven¬ 
tional  classroom  manner  and  which  would  be  taught  by  programmed 
instruction.  Since  the  classes  consisted  mostly  of  girls,  it  was 
decided  to  use  them  as  the  experimental  group.  This  provided  a 
total  of  175  subjects,  96  taught  by  the  conventional  classroom 
method  and  79  taught  by  programmed  instruction. 

The  unit  on  logarithms  was  selected  for  the  study  because 
for  the  first  time  (1964-65)  it  was  included  in  the  content  of 

4 

Mathematics  20.  The  investigator  was  able  to  obtain  permission 
from  the  Royal  Canadian  Air  Force  Instructional  Wing,  Clinton, 
Ontario,  to  use  the  programmed  material"*  available  on  this  unit. 
This  material  was  prepared,  tested  and  revised  several  times  over 
a  period  of  two  years  using  approximately  1000  subjects. 

The  Cooperative  Tes t :  Intermediate  Algebra  (Quadratics  and 
Beyond)  Form  Y  was  administered  to  all  the  classes  during  April, 
1965.  These  results  were  used  to  determine  the  level  of  achieve¬ 
ment  of  the  students  prior  to  initiation  of  the  study.  When  the 
unit  on  logarithms  was  completed,  Form  Z_  of  the  Cooperative  Test : 
Intermediate  Algebra  (Qiiadratics  and  Beyond)  was  administered  for 

4 

Senior  High  School  Mathematics  Subcommittee,  Senior  High 
School  Mathematics  Bulletin ,  April  1964,  p.  25. 

"*W.  H.  Farrel  and  others.  Introductory  Mathematics:  Powers 
of  Ten  and  Logarithms  (Training  Standards  and  Development  Division, 
Royal  Canadian  Air  Force,  1962). 
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the  purpose  of  measuring  growth  and  for  making  comparisons.  Three 
weeks  later  a  Retention  Test  was  administered  for  the  purpose  of 
measuring  retention  of  the  content  taught  during  the  study. 

Total  and  Verbal  scores  obtained  from  the  School  and  College 
Ability  Test  (SCAT)  administered  at  the  time  the  students  wrote  the 
grade  IX  departmental  examinations  and  as  recorded  by  the  Department 
of  Education  were  used  to  separate  the  students  into  two  categories. 

Each  teacher  taught  one  class  in  the  conventional  manner  and 
supervised  the  other  during  the  regular  mathematics  periods.  No 
assistance  was  given  to  the  later  class.  The  programmed  material 
was  collected  at  the  end  of  each  period  and  kept  by  the  teacher 
until  the  next  mathematics  period  at  which  time  it  was  re-distri¬ 
buted  to  the  students.  Extra  exercises  were  available  to  the  stu¬ 
dents  using  the  programmed  material  so  that  both  classes  completed 
the  unit  at  approximately  the  same  time.  The  teachers  were  urged 

to  relate  their  teaching  techniques  as  closely  as  possible  with 

£ 

the  suggested  procedure  in  the  text.  In  this  way  it  was  hoped 
to  reduce  the  differences  in  teaching  approach  of  the  individual 
teachers.  Every  attempt  was  made  to  keep  other  variables  as  con¬ 
stant  as  possible. 

The  findings  of  the  experiment  are  based  on  the  statistical 
analyses  of  the  data  gathered  from  the  study. 

^Bowers,  Miller  and  Rourke,  Mathematics  for  Canadians,  Book 
III  (Toronto:  J.  M.  Dent  and  Sons  (Canada)  Ltd.,  and  the  MacMillan 
Company  of  Canada  Ltd.,  1950). 


■ 
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V.  SIGNIFICANCE  OF  THE  PROBLEM 

There  is,  of  course,  no  doubt  that  the  improvement  of  public 
education  depends  substantially  on  research.  It  is  not  difficult 
to  imagine  the  reaction  of  teachers  when,  years  ago,  the  first  text¬ 
book  was  published.  The  teacher  was  not  replaced  by  the  textbook 
but  the  role  of  the  teacher  was  changed.  Freed  from  the  need  to 
present  all  of  the  content,  the  teacher  had  more  time  to  explain 
the  more  enrichening  points  of  the  subject  and  to  maintain  student 
interest . 

In  recent  years,  one  of  the  more  important  developments  in 
the  field  of  education  has  been  the  introduction  of  programmed 
instruction.  Very  briefly,  it  can  be  stated  that  programmed  in¬ 
struction  is  a  system  of  teaching  which  exploits  fully  certain  basic 
principles  of  learning.  The  learning  principles  are:  the  presenta¬ 
tion  of  small,  even  minute,  steps;  active  response  by  each  student; 
immediate  confirmation  of  progress;  allowance  for  individual  dif¬ 
ferences  and  immediate  and  constant  reinforcement.  Since  its  in¬ 
troduction  programmed  instruction  has  had  its  "ups"  and  "downs"  but 

the  new  attitude  toward  the  student  -  that  every  student  can  learn 

-  can  bear  further  investigation.  This  requires  teachers  to  crit¬ 
ically  examine  their  own  methods  of  instruction  in  light  of  the 
classroom  situation. 

In  evaluating  programmed  instruction  the  critical  area 
should  be  the  prepared  program  and  not  the  various  refinements  of 
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technique  such  as  the  "programmed  text"  or  the  "teaching  machine" 
(Unfortunately,  it  is  this  latter  aspect  which  has  received  the 
most  publicity.) 

An  increasing  number  of  programs  are  now  becoming  commer¬ 
cially  available  in  a  variety  of  subject  matter  areas,  Mere 
availability  is  no  guarantee  of  quality  and  visual  inspection 
alone  is  not  a  sound  criterion  for  judging  the  programs.  In  a 
study  reported  by  Ernst  Z.  Rothkopf^  a  near  perfect  record  of  mis 
taken  judgment  was  made  by  a  group  of  high  school  principals  and 
teachers  who  had  just  completed  a  three-week  course  in  programmed 
instruction.  Their  selection  of  programs  was  plotted  against  the 
actual  effectiveness  as  measured  by  a  valid  recall  post-test. 

It  is  only  by  gathering  empirical  evidence  that  the  effec¬ 
tiveness  of  programmed  instruction  can  be  measured  and  it  is  only 
in  this  way  that  education  can  increase  its  efficiency  in  an  era 
when  efficiency  is  the  vital  element  in  keeping  pace  with  the 
demands  of  the  future. 

VI.  DEFINITION  OF  TERMS 

In  general,  the  meaning  of  each  of  the  following  terms  and 
abbreviated  forms  of  reference  are  indicated  where  first  used, 
but,  for  easy  reference  the  following  list  is  presented: 

^Ernst  Z.  Rothkopf,  Bell  Telephone  Laboratories  Inc. , 
Journal  of  Programmed  Instruction  (Summer  1963) . 
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"Branching"  is  a  particular  type  of  program  which  has 
built-in  alternate  sequences.  If  a  student  makes  a  wrong  re¬ 
sponse  in  a  certain  area,  he  is  directed  through  alternate  steps 
in  the  program  designed  to  remedy  his  lack  of  understanding  through 
additional  explanations.  Similarly,  if  a  student  demonstrates 
through  a  long  series  of  correct  responses  that  he  has  the  required 
understanding  of  the  subject  matter,  he  may  "skip"  over  additional 
information  on  the  same  topic. 

"CON"  refers  to  the  group  of  students  in  the  experiment  who 
were  taught  by  the  conventional  classroom  method. 

"COOP"  refers  to  the  Cooperative  (Mathematics)  Tests . 

"Covert"  response  is  a  non-active  response  to  a  question 
such  as  thinking  of  an  answer  without  writing  anything  down, 
pressing  a  button,  etc. 

"Eclectic  programming"  incorporates  the  more  desirable 
features  of  both  the  extrinsic  and  intrinsic  formats. 

"Error  rate"  either  refers  to  the  number  of  errors  a 
student  makes  in  completing  a  program  or  to  the  percentage  of  the 
students  giving  wrong  responses  to  a  specific  item  on  the  program. 

It  has  value  as  a  criterion  in  determining  revisions  to  the  program. 

"Extrinsic  programming"  is  a  linear  Skinnerian  type  of  pro¬ 
gramming  in  which  the  program  sequence  is  unalterable  and  is  the 
same  for  all  students. 

"Frame"  is  a  unit  of  the  program  which  requires  a  response 
from  the  student.  The  information  required  to  answer  a  given  item 
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is  contained  in  that  item,  in  a  preceding  item  or  in  both. 

"Intrinsic  programming"  employs  the  branching  technique 
where  all  possible  sequences  of  item  presentation  are  built  into 
the  program  and  controlled  by  the  student  responses  rather  than 
by  any  outside  agency. 

"Overt"  response  involves  a  physical  activity  on  the  part 
of  the  student  such  as  writing,  pressing  a  button,  etc. 

"Pacing"  involves  having  the  learner  proceed  at  a  rate  at 
which  almost  all  his  responses  are  correct.  In  this  way  desired 
behavior  is  reinforced. 

"PROG"  refers  to  the  group  of  students  in  the  experiment 
who  were  taught  by  the  method  of  programmed  instruction. 

"Program"  consists  of  the  subject  matter  arranged  in  units 
(frames)  in  such  a  way  as  to  facilitate  instruction. 

"Prompts"  are  stimuli  included  in  a  program  to  increase  the 
probability  that  a  given  response  will  occur. 

"Reinforcement"  is  a  basic  concept  of  pyschology  of  utmost 
importance  to  programmed  instruction  theory.  In  order  that  a 
student  retain  a  piece  of  information  effectively,  it  must  be 
reinforced  by  informing  him  that  he  is  right. 

"SCAT"  refers  to  the  Cooperative  School  and  College  Ability 

Test. 

"Total  SCAT  score"  refers  to  the  sum  of  the  scores  of  the 
subtests  of  the  SCAT  tes t . 

"Verbal  SCAT  score"  refers  to  the  score  of  the  verbal  subtest 


of  the  SCAT  test. 


' 
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VII.  OUTLINE  OF  THE  REPORT 

The  present  chapter  is  an  introduction  to  and  a  preview  of 
the  study.  Chapter  II  consists  of  an  explanation  of  programmed 
instruction  and  a  review  of  the  literature  that  has  a  bearing  on 
the  study.  Chapter  III  gives  a  detailed  description  of  the  design 
of  the  experiment  and  the  statistical  procedures  used  in  analyzing 
the  data.  Chapter  IV  gives  the  results  from  the  statistical  anal¬ 
yses.  Chapter  V  is  devoted  to  a  summary  of  the  investigations 
along  with  the  conclusions  and  implications  for  further  research. 


CHAPTER  II 


REVIEW  OF  THE  LITERATURE 

Programmed  materials  have  had  a  relatively  short  but 
colorful  history.  This  history  has  included  charges  and  claims 
that  have  threatened  to  embroil  this  instructional  tool  so  deeply 
in  controversy  that  it  would  have  little  opportunity  to  make  its 
impact  on  education.  Yet,  in  a  nation-wide  survey  of  practices 
and  innovations  in  American  schools,  Leonard^"  suggests  that  pro¬ 
grammed  instruction  challenges  all  educators  to  critically  examine 

2 

and  improve  their  method  of  instruction.  In  a  report  published 

in  the  Reader's  Digest  the  claim  is  made  that  learning  power  can 

be  doubled  with  proper  utilization  of  programmed  instruction.  Two 

3 

senior  officials  of  the  Russian  Bureau  of  Education  when  asked  to 
give  their  appraisal  of  Canadian  facilities  they  visited  on  a 

■'‘G.  B.  Leonard  (senior  ed) ,  Testing  vs.  Your  Child  (New  York 
Look,  March  11,  1966),  p„  64-68. 

2 

W.  Langewiesche ,  Now  You  Can  Double  Your  Learning  Power 
(Montreal:  The  Reader's  Digest,  April,  1967),  p.  27-31. 

3 

A.  N.  Osipov,  Associate  deputy  minister  for  vocational 
education  and  A.  I.  Postukhov,  senior  inspector  for  technical 
education,  U.S.S.R. ,  in  an  interview  with  Southam  Press,  1966. 


. 
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cross-country  tour  said  they  were  surprised  they  had  seen  no  pro¬ 
grammed  instruction  in  use.  In  Russia,  this  method  of  instruction 
is  used  extensively  at  all  levels  of  education. 

Because  much  of  the  controversy  is  centered  on  how  learning 
takes  place,  this  aspect  and  its  application  to  programmed  instruc¬ 
tion  are  now  considered. 

I.  THE  NATURE  OF  THE  LEARNING  PROCESS 


A  teacher’s  conception  of  learning  and  of  the  learner 
determines  to  a  large  extent  his  activity  in  the  classroom.  Tolman 
suggested  that  we  should  not  limit  ourselves  to  a  single  theory: 

I  wish  to  suggest  that  our  familiar  theoretical  disputes  about 
learning  may  perhaps  ...  be  resolved  if  we  can  agree  that  there 
are  really  a  number  of  different  kinds  of  learning.  For  it  may 
then  turn  out  that  the  theory  and  laws  appropriate  to  one  kind 
may  well  be  different  from  those  appropriate  to  other  kinds . ^ 

Fehr  explains  human  learning  as: 

A  change  in  behavior  acquired  through  an  experience.  The 
learning  is  usually  directed  towards  specific  goals  through 
patterns  of  experience. ^ 

Further,  it  is  emphasized  that  any  formulation  of  learning 
that  facilitates  a  technological  approach  to  instruction  must  be 


A 

E.  C.  Tolman,  "There  is  More  than  One  Kind  of  Learning," 
Psychological  Review,  56  (1949),  p.  144. 

^H.  Fehr,  "Theories  of  Learning  Related  to  the  Field  of 
Mathematics,"  The  Learning  of  Mathematics ,  Its  Theory  and  Practice , 
(Washington,  D.C.:  The  National  Council  of  Teachers  of  Mathe¬ 
matics,  1953),  XXI,  p.  2. 
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one  in  which  internal  changes  are  considered  to  result  in  a  new 

g 

capability  for  some  type  of  performance.  According  to  Skinner  per¬ 
formance  is  the  effect  of  learning  on  behavior  and  is  the  external 
sign  that  learning  has  occurred.  Gagne7  explains  that  the  kind  of 
change  called  "learning"  exhibits  itself  as  a  change  in  performance, 
and  the  inference  of  learning  is  made  by  comparing  what  performance 
was  possible  before  the  individual  was  placed  in  a  learning  situation 
and  what  performance  can  be  exhibited  after  such  experience. 

The  process  through  which  meaningful  learning  occurs  is  a 

g 

subtle,  intricate  and  complex  phenomenon.  According  to  Ausubel 
this  process  involves  the  incorporation  of  a  new  learning  task  into 
existing  cognitive  structure  so  that  a  meaningful  relationship  is 
established.  The  new  information  must  be  mentally  processed  by  the 
learner  so  that  it  becomes  an  integral  part  of  his  own  particular 
system  of  knowledge.  The  learner  must  translate  the  new  information 
into  his  own  frame  of  reference.  This  interaction  of  a  new  learning 
task  with  existing  cognitive  structure  is  the  distinctive  feature 
of  meaningful  learning. 

g 

B.  F.  Skinner,  "Reflections  of  a  Decade  of  Teaching  Machines," 
Programmed  Learning  and  Teaching  Machines  II ,  Data  and  Directions 
(National  Education  Association,  1966),  p.  5. 

^R.  M.  Gagne,  The  Conditions  of  Learning  (New  York:  Holt, 
Rinehart,  and  Winston,  Inc.,  1965). 

8 

D.  P.  Ausubel*  The  Psychology  of  Meaningful  Verbal  Learning 
(New  York  and  London:  Gruen  and  Stratton,  1963). 
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Since  the  occurrence  of  meaningful  learning  is  the  result 
of  the  cognitive  activity  of  the  learner  himself,  the  proponents 
of  this  theory  of  learning  claim  that  learning  does  not  have  to 
occur  in  the  physical  presence  of  a  teacher.  However,  for  learning 
to  take  place  most  efficiently  and  effectively  the  learning  process 
does  need  to  be  controlled.  This  process  of  exercising  control  is 
called  teaching. 

The  control  of  the  learning  process  is  attained  by  structur¬ 
ing  a  learning  situation  so  that  each  student  experiences  a  series 
of  learning  activities  by  which  he  is  continually  guided  toward 
achievement  of  the  goals  which  have  been  set  for  him.  The  learner 
cannot  be  regarded  as  a  passive  agent  but  must  be  considered  as  an 
active  participant  in  his  own  learning.  It  must  be  recognized  that 
the  efficiency  with  which  the  learning  process  is  executed  will  vary 
with  each  learner,  depending  on  his  own  cognitive  structure  and  his 
ability  to  process  information.  Gains  in  learning  will  result 
directly  from  the  effects  of  structuring  the  learning  situation  so 
that  students  are  mentally  engaged  in  learning  activities  and  also 
to  the  extent  that  instructional  guidance  is  provided  on  an  indiv¬ 
idual  basis. 


II.  UTILIZATION  OF  PROGRAMMED  INSTRUCTION 
IN  THE  LEARNING  PROCESS 


If  by  a  miracle  of  mechanical  ingenuity,  a  book  could  be  so 
arranged  that  only  to  him  who  had  done  what  was  directed  on  page 


. 
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one  would  page  two  become  visible,  and  so  on,  much  that  now 
requires  personal  instruction  could  be  managed  by  print .9 

Ayers,  in  a  paper  presented  to  the  Third  Canadian  Conference 

on  Educational  Research  cautioned  against  attempts  to  develop  a 

single  theory  of  instructions  Furthermore  he  stated: 

If  we  do  not  limit  ourselves  to  one  theory  of  learning  or  one 
theory  of  instruction,  but  select  the  most  appropriate,  then 
programmed  instruction  in  its  widest  sense  can  serve  as  a  use¬ 
ful  tool. 

Programmed  instruction  is  a  new  technological  approach  to 
the  development  of  instructional  materials.  It  condenses  the  nec¬ 
essary  learning  experiences  as  concisely  and  systematically  as 
possible  to  insure  that  instructional  objectives  are  achieved  as 
efficiently  as  possible.  The  initial  procedure  in  the  programming 
process  is  to  formulate  the  desired  instructional  objectives  in 
such  a  manner  as  to  allow  the  degree  to  which  they  are  achieved  by 
the  learner  to  be  empirically  measured.  An  instructional  objective 
is  a  statement  which  describes  an  intended  outcome  of  instruction. 

To  be  measurable  the  objective  must  describe  an  intended  outcome 
in  operational  terms,  i.e.,  what  activities  will  the  learner  be 
able  to  perform  upon  completion  of  instruction.  After  the  object¬ 
ives  have  been  properly  formulated  and  a  valid  measuring  instrument 

9 

E.  L.  Thorndike,  Education  (New  York:  Macmillan  Company, 

1912) . 

■^J.  D.  Ayers,  "Programmed  Instruction  -  Its  Potential," 
Canadian  Education  and  Research  Digest  4  (September,  1964),  pp.  219- 
220. 
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has  been  constructed,  a  level  of  performance  is  established  as  a 
criterion  of  acceptable  performance. 

The  basic  concept  of  the  programmed  approach  is  that  all 
learners  who  possess  the  necessary  knowledge  prerequisites  should 
achieve  the  established  criterion  of  acceptable  performance.  If 
these  learners  fail  to  understand  any  part  of  the  subject  matter 
or  fail  to  reach  the  criterion  level,  it  is  not  the  fault  of  the 
learners,  but  a  signal  that  there  is  a  weakness  in  the  instructional 
process.  These  weaknesses  must  be  located  and  revisions  and  adjust¬ 
ments  made  until  they  are  eliminated. 

The  basic  learning  principle  that  facilitates  this  approach 
requires  that  the  student  be  actively  and  continually  involved  in 
the  learning  experiences  he  encounters.  The  programmed  approach 
utilizes  this  principle  by  breaking  up  subject  matter  into  segments 
called  "frames"  and  presenting  only  one  frame  at  a  time.  The 
learner  is  asked  to  make  an  observable  response  (usually  a  written 
response)  to  each  frame  of  the  subject  matter.  Having  to  actually 
make  an  active  response  maintains  his  constant  attention  and  also 
forces  discriminative  thinking  about  the  material  being  presented. 

Another  important  learning  principle  is  that  of  immediately 
informing  the  learner  as  to  the  adequacy  of  his  response.  Immediate 
knowledge  of  correct  responses  lets  a  student  know  that  he  under¬ 
stands  that  part  of  the  subject  matter  and  is  ready  to  proceed  to 
the  next.  This  maintains  a  high  level  of  confidence,  has  a  rein¬ 
forcing  effect  and  provides  a  strong  motivating  force.  Immediate 
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knowledge  of  incorrect  responses  lets  him  know  that  he  does  not 
understand  that  part  of  the  subject  matter  before  he  encounters  the 
next,  and  that  he  needs  to  review  or  ask  for  additional  explana¬ 
tion  before  proceeding.  The  programmed  approach  utilizes  this 
principle  by  presenting  the  material  in  such  a  manner  so  that  after 
the  learner  has  responded,  the  correct  response  is  available  with 
which  to  compare  his  own  before  encountering  the  next  frame  of 
subject  matter. 

Another  principle  which  is  most  critical  to  the  learning 
process  is  that  of  allowing  each  individual  student  to  proceed  at 
his  own  pace.  This  allows  each  learner  as  much  time  as  he  needs  to 
comprehend  each  part  of  the  subject  matter  and  make  an  adequate 
response.  Since  the  programmed  approach  does  not  indicate  a  time 
limitation  a  student  can  actually  learn  at  his  own  optimum  rate. 

The  application  of  these  principles  not  only  increases  the 
effectiveness  with  which  subject  matter  is  learned  but  also  makes 
possible  a  systematic  try-out  and  revision  procedure.  The  purpose 
of  this  procedure  would  be  to  make  revisions  in  the  instruction 
until  it  fits  the  psychological  state  of  the  learner. 

The  final  process  to  which  programmed  materials  are  sub¬ 
jected  is  a  systematic  validation  procedure.  It  answers  the  ques¬ 
tion,  "Does  the  program  actually  accomplish  what  it  purports  to 
accomplish?"  Tests  are  made  up  of  items  which  require  the  learner 
to  perform  the  operation  stated  in  the  objectives. 
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Further,  Crawford  states  that  because  of  the  highly  sequen¬ 
tial  nature  of  mathematics,  programmed  instruction  seems  to  possess 
features  favorable  to  teaching  mathematics.  He  sums  up  his  survey 
of  teaching  methods  by  saying  that  mathematics  has  to  be  learned 
rather  than  taught  and  that  three  general  ways  of  ensuring  this 
involves  the  use  of  discovery,  games,  and  programmed  instruction. 

III.  PROGRAMMED  INSTRUCTION  TECHNIQUES 

Without  going  into  a  lengthy  discourse  into  the  various 
methods  of  programmed  instruction,  the  details  of  which  are  avail¬ 
able  in  many  sources,  notably,  "Automated  Teaching:  The  State  of 

12  13 

the  Art"  and  "Teaching  Machines  and  Programmed  Learning"  ,  it  is 

appropriate  to  mention  briefly  the  two  major  "schools".  B.  F.  Skinner 
of  Harvard  University  developed  a  method  which  is  based  fundamentally 
on  the  behavioral  psychology  concept  of  learning.  The  material  to 
be  learned  is  presented  in  very  small  steps  or  frames  which  are  care¬ 
fully  "programmed"  in  order  to  elicit  the  desired  responses  and 
guide  the  student  to  the  required  mastery  of  the  subject  matter. 

^D.  H.  Crawford,  "Developments  in  School  Mathematics  in 
Canada  -  A  Survey,"  Canadian  Education  and  Research  Digest  4  (December 
1964),  pp.  314-315. 

12 

E.  H.  Galenter  (ed) ,  Automated  Teaching:  The  State  of  the 
Art  (New  York:  John  Wiley  and  Sons,  1959),  198  pages. 

13 

A.  A.  Lumsdaine  and  R.  Glaser,  Teaching  Machines  and 
Programmed  Learning  (National  Education  Association  of  the  United 
States,  October,  1960),  724  pages. 


■ 


19 


The  "Skinnerian"  method  is  described  as  "linear  programming". 

N.  A.  Crowder  of  the  "Western  Design  Division"  of  "United 
States  Industries"  developed  a  method  whereby  material  is  presented 
in  a  variable  sequence  depending  upon  the  progress  of  the  individual 
student.  A  small  amount  of  material  is  presented  followed  by  a 
multiple-choice  question.  Dependent  upon  which  answer  the  student 
selects,  he  is  referred  to  one  of  three  or  more  alternative  pages. 

On  the  page  he  selects,  the  student  is  informed  (if  his  answer  is 
incorrect)  of  the  nature  of  his  error  and/or  provided  with  addi¬ 
tional  information  and  referred  back  to  the  original  question. 

This  method  is  described  as  "branching  programming". 

There  has  been  much  discussion  regarding  the  pros  and  cons 
of  the  various  methods  of  programming.  There  is,  however,  evidence 
in  the  literature  that  the  divergent  methods  of  programming  are 
becoming  somewhat  closer  in  approach.  Some  programs  seldom  branch 

but  do  provide  remedial  or  enrichment  materials  at  appropriate 
14 

points.  Some  programs  provide  the  better  student  with  opportunities 
to  "bridge"  over  certain  material  designed  to  give  extra  instruction 
for  less  able  students. ^ 


Modern  Mathematics  For  the  Junior  High  School  (Encyclo¬ 
paedia  Britannica  Press,  Inc. ,  Britannica  House,  Toronto).  n.d. 

^Modern  Algebra  -  A  First  Course  (Encyclopaedia  Britannica 
Press,  Inc.,  Britannica  House,  Toronto),  n.d. 


. 
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IV.  RELATED  STUDIES  AND  RESEARCH 

Changes  made  in  mathematics  by  modern  research  are  equally  as 
profound  as  those  in  chemistry,  physics,  and  biology.  The  twenti¬ 
eth  century  may  well  become  the  golden  age  of  mathematics,  since 
more  mathematics  and  more  profound  mathematics  has  been  created  in 
this  period  than  during  all  the  rest  of  history.  If  our  schools 
are  to  reap  the  benefits  of  the  progress  made  in  mathematics  cer¬ 
tain  requirements  must  be  met:  in-service  retraining  of  teachers, 
better  pre-service  training  and  improved  teaching  techniques.  The 
review  of  the  literature  will  be  concerned  with  programmed  instruc¬ 
tion  as  a  technique  of  teaching. 

Deterline  summarized  a  number  of  findings  of  experiments 
involving  the  technique  of  programmed  instruction.  The  first  field 
study  designed  to  test  the  effectiveness  of  auto-instruction  was 
conducted  by  Klaus  and  Lumsdaine  (1960,  1961).  Some  physics 
classes  from  Pittsburgh  high  schools  were  provided  with  a  linear 
program  dealing  with  electricity  and  light  to  be  used  as  a  supple¬ 
ment  to  their  regular  classroom  instruction  in  this  subject  area. 
Some  classes  were  provided  with  additional  study  workbooks  while 
still  other  classes  followed  the  ordinary  classroom  instruction. 

The  performance  of  the  students  using  the  workbooks  was  compared 
with  that  of  the  students  using  the  program: 

The  results  indicated  that  the  classes  using  the  program  as 
a  supplement  did  better  on  an  achievement  test  than  the 
students  who  had  used  neither  the  program  nor  the  workbook. 


* 
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The  workbook  classes  were  superior  to  those  having  neither 
workbook  nor  program  but  were  inferior  in  performance  to  the 
classes  which  had  used  the  program. ^ 

In  another  study  done  by  the  same  research  team,  high  school 
classes  were  used  in  a  slightly  different  way;  some  were  instructed 
by  program  alone,  while  others  had  the  program  plus  teacher  instruc¬ 
tion.  There  was  no  significant  difference  in  performance  level. 

Schramm  summarized  a  great  deal  of  research  with  programmed 

instruction  which  took  place  during  the  sixties.  He  estimated  that 

80  percent  of  this  research  dealt  with  testing  and  comparing  various 

kinds  or  parts  of  the  programs.  He  also  found  that: 

Among  the  remaining  research  experiments  there  are  a  consid¬ 
erable  number  of  evaluative  tests  which  seek  to  compare  the 
amount  of  learning  from  programs  with  conventional  classroom 
teaching  of  the  same  subject.  A  few  experiments  dealt  with 
special  applications  of  the  program  -  to  slow  learners,  deaf 
children,  to  industrial  trainees  and  other  groups. 17 

In  answer  to  the  question  of  whether  students  learn  from 

programmed  instruction,  Schramm  says: 

They  do  indeed  learn  .  .  .  But  the  question,  how  well  they 
learn  from  other  kinds  of  instruction,  we  cannot  answer  con¬ 
fidently  .  .  .  let  us  record  some  of  the  evidence  comparing 
programs  with  conventional  classroom  instruction.  We  have 


W.  A.  Deterline,  An  Introduction  to  Programmed  Instruction 
(Englewood  Cliffs,  N. J. :  Prentice  Hall,  1962),  pp.  61-62. 

17W.  L.  Schramm,  "The  Research  of  Programmed  Instruction:  An 
annotated  Bibliography,"  United  State  Office  of  Education  Bulletin 
No.  35  (Washington,  D.  C. :  U.  S.  A.  Department  of  Health,  Education 
and  Welfare,  1964),  pp.  2-3. 


. 
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tabulated  36  such  reports  ...  Of  the  36  comparisons,  18 
showed  no  significant  differences  when  the  two  groups  were 
measured  on  the  same  criterion  test.  But  17  showed  a  sig¬ 
nificant  superiority  for  the  students  who  worked  with  the 
programs  and  only  one  showed  a  final  superiority  for  the 
conventional  classroom  method. ^ 

Strembisky,  in  an  appraisal  of  research  in  programmed 

instruction  recorded  that  the  research  was  restricted  to  limited 

19 

number  of  areas.  His  appraisal  study  revealed  that  there  was 
a  tendency  to  favor  programmed  instruction  in  mathematics  at  the 
elementary  level,  but  the  majority  of  the  findings  were  not  rated 
as  highly  dependable.  An  even  greater  tendency  was  found  to  favor 
programmed  instruction  at  the  junior  high  school  level,  but  again, 
the  majority  of  the  findings  were  not  rated  as  being  highly  depend¬ 
able.  At  the  high  school  level  there  were  no  dependable  findings 
but  the  general  trend  did  indicate  that  programmed  instruction  and 
conventional  techniques  were  equally  effective  in  teaching  mathe¬ 
matics.  The  appraisal  revealed  that  programmed  instruction  in 
mathematics  could  be  most  successful  in  comparison  to  the  conven¬ 
tional  methods,  at  the  college  level.  Most  of  the  findings  were 
rated  as  dependable  and  indicated  that  programmed  instruction 
was  at  least  as  effective  as  the  traditional  methods  of  instruc¬ 
tion. 


18 

W.  Schramm,  ojd.  cit ♦  ,  pp.  3-4. 

19 

J.  Strembisky,  "An  Appraisal  of  Research  in  Programmed 
Instruction."  Unpublished  Master’s  thesis,  The  University  of 
Alberta,  1964. 
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Research  at  the  elementary  school  level .  MacDonald  con¬ 
ducted  an  experiment  in  teaching  fractions  to  grade  VI  Indian, 
Eskimo,  Metis,  and  white  students  residing  in  the  Northwest  Terri¬ 
tories,  using  four  different  methods: 

Method  A  -  Programmed  instruction  only. 

Method  B  -  Programmed  instruction  and  minimal 
teacher  participation. 

Method  C  -  Programmed  instruction  and  more  teacher 
participation. 

Method  D  -  Conventional  teaching  only. 

The  four  groups  were  matched  in  I.Q.,  ethnic  origin  and  grade 
level.  They  were  comparable  in  other  factors.  Analysis  of  the 
results  revealed  that: 

1.  Learning  took  place  in  each  group. 

2.  Method  C  was  the  best  of  the  programmed  instruction 
methods . 

3.  There  was  no  significant  difference  between  method  C  and 
method  D. 

4.  White  pupils  in  group  C  did  better  on  the  post-test  than 
white  pupils  in  all  other  groups. 

5.  Native  pupils  showed  no  significant  difference  between 

20 

method  C  and  method  D. 


H.  A.  MacDonald,  "Programmed  Instruction  with  Teacher 
Participation:  An  Experiment  in  Teaching  Fractions  to  Children  Who 

Reside  in  the  Northwest  Territories."  Unpublished  Master's  Thesis, 
The  University  of  McGill,  Montreal,  1966. 
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Research  at  the  junior  high  school  level.  Randolph  con¬ 
ducted  an  experiment  in  modern  mathematics  (sets,  relations,  and 
functions)  with  programmed  instruction.  The  experiment  extended 
over  a  period  of  nine  weeks.  The  conclusions  recorded  were: 

i 

1.  That  there  was  a  real  gain  in  achievement.  This  con- 

21 

firmed  a  study  by  McGarvey  who  had  reported  outstanding  results. 

2.  That  students  tended  to  become  tired  of  programmed 
instruction,  which  confirmed  a  conclusion  arrived  at  by  Henderson. 
However,  whereas  Henderson  reported  that  programmed  instruction 
was  valuable  for  the  slower  student,  Randolph  indicated  that  it 

was  more  suitable  for  the  brighter  student .  (There  is  a  possibility 
that  programmed  instruction  is  a  valuable  aid  for  both  extremes  of 
students,  with  different  materials  for  each  extremity.) 

3.  That  gifted  students  in  junior  high  schools  can  learn 

advanced  material  by  programmed  learning  and  can  benefit  from  such 
23 

a  program. 


Research  at  the  senior  high  school  level.  Jordy  carried  out 
a  comparative  study  of  methods  of  teaching  plane  geometry  in  high 


21p.  McGarvey,  "Programmed  Instruction  in  Ninth-Grade  Algebra," 
The  Mathematics  Teacher,  LV  (November,  1962),  pp.  576-578. 

22 

G.  L.  Henderson,  "An  Independent  Classroom  Experiment  Using 
Teaching  Machine  Programmed  Materials,"  The  Mathematics  Teacher,  LVI 
(April,  1963),  pp.  248-251. 
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P.  H.  Randolph,  "An  Experiment  in  Programmed  Instruction 
in  Junior  High  School,"  The  Mathematics  Teacher,  LVII  (March,  1964), 

pp .  160-162. 
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school.  One-  group  of  grade  XI  students  used  programmed  materials 
and  another  group  was  instructed  by  the  conventional  lecture- 
recitation  method.  A  reading  test  was  administered  as  well  with 
the  purpose  of  investigating  the  effect  on  the  reading  level  bet¬ 
ween  the  two  groups.  The  outcomes  reported  by  the  author  were: 

1.  Ability  directly  affects  the  achievement  in  plane 
geometry.  When  a  student  has  the  opportunity  to  learn  at  his  own 
rate  of  comprehension,  learning  is  increased  and  understanding  is 
improved. 

2.  The  boredom  arising  from  the  use  of  programmed  materials 
can  be  reduced  by  using  materials  written  on  an  individual  unit 
basis  and  also  to  allow  some  class  time  for  discussion. 

3.  Programmed  learning  did  improve  the  overall  reading 
ability.  Reading  for  comprehension  was  reinforced. 

4.  Where  the  maturity  of  the  students  involved  is  great 

enough  that  they  accept  the  rigors  of  self-discipline  necessary 

for  successful  completion  of  programmed  materials  and  have  above 

24 

average  ability,  programmed  materials  have  a  definite  value. 

Research  at  the  college  level.  This  experiment  conducted 
by  Dobyns  could  be  classified  as  a  related  project.  Dobyns  used 
six  classes  of  thirty  students  from  the  Louisiana  State  College. 

24 

J.  L.  Jordy,  "A  Comparative  Study  of  Methods  of  Teaching 
Plane  Geometry."  The  Mathematics  Teacher  LVII  (November,  1964), 
pp.  472-478. 
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Three  teachers  participated  in  the  study  and  taught  two  classes  each. 
One  class  was  given  programmed  materials  and  the  other  class  was 
taught  by  the  conventional  method.  The  subject  matter  consisted  of 
sets,  numbers  and  algebra  of  numbers  as  a  logical  system.  Each 
class  met  nine  times.  During  the  next  ten  classes  both  groups  were 
taught  by  the  conventional  method  the  topic  of  logic.  During  the 
third  phase  the  three  classes  that  did  not  use  programmed  materials 
previously  were  given  such  materials  dealing  with  inequalities, 
absolute  values,  coordinate  systems,  functions  and  their  graphical 
representation.  The  other  classes  were  taught  in  the  conventional 
manner.  Tests  were  administered  at  the  end  of  each  phase  to  all  the 
classes . 

On  the  basis  of  the  analysis  the  following  conclusions  were 

made : 

1.  The  programmed  booklets  covering  sets,  numbers,  and  the 
algebra  of  numbers  as  a  logical  system  provided  a  means  of  instruc¬ 
tion  which  was  as  effective  as  the  conventional  method, 

2.  The  programmed  booklets  covering  inequalities,  absolute 
values,  coordinate  systems  and  their  graphical  representation  pro¬ 
vided  a  means  of  instruction  which  was  more  effective  than  the  con¬ 
ventional  method  of  teaching. 

3.  After  being  taught  by  programmed  instruction,  the  stu¬ 
dents  still  learned  effectively  by  the  conventional  method  of 


instruction. 


. 
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4.  The  experiment  provided  validation  of  the  programmed 

booklets  as  a  method  of  instruction  for  the  materials  which  they 
25 

cover. 

Research  with  different  programmed  instruction  methods . 
Branching  and  linear  presentation  of  programmed  materials  tend  to 
be  equally  effective.  In  a  study  reported  by  the  Royal  Canadian 
Air  Force  programmed  instruction  was  used  as  a  teaching  medium  of 
basic  mathematics  required  by  trainees  in  the  Radar  and  Communica¬ 
tions  School.  One  group  of  400  trainees  used  a  branching  program  and 
another  group  used  a  linear  program.  The  two  programs  were  developed 
and  equated  for  difficulty  through  experimentation  with  random  groups 
of  trainees  available  the  previous  year.  The  trainees  spent  ninety 
minutes  per  day  on  the  programs  for  approximately  two  weeks.  No 
talking  or  discussion  was  permitted  during  the  sessions  and  trainees 
were  not  permitted  to  take  the  programmed  material  out  of  the  class¬ 
room.  Although  this  study  did  not  evaluate  the  relative  merits  of 
the  two  programs,  other  conclusions  became  apparent: 

1„  Both  groups  showed  a  significant  increase  in  achievement. 
The  group  using  the  branching  program  showed  an  increase  of  21.3 
percent  and  the  group  using  the  linear  program  an  increase  of  17.0 
percent. 

25 

R.  A.  Dobyns ,  "An  Experiment  in  the  Teaching  of  College 
Algebra,"  The  Mathematics  Teacher,  LVII  (February,  1964), 

pp.  86-88. 
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2.  Effective  learning  can  be  attained  through  the  use  of 
programmed  materials  alone. 

3.  Students  of  widely  varying  educational  backgrounds 
(Grade  7  to  first  year  university)  can  learn  from  the  same  program 
at  the  same  time.^ 


Research  with  different  methods  of  responding.  Unruh  con¬ 
ducted  an  investigation  in  this  area.  With  a  program  on  grammar, 
students  who  responded  covertly  (A)  and  overtly  (B)  to  materials 
presented  by  machine  learned  significantly  more  than  students  who 
read  the  program,  filled  in  blanks  and  underlined  (C) ,  or  students 
who  studied  textual  material  and  did  a  daily  quiz  (D) .  Group  (B) 
took  fifty  percent  more  time  to  complete  the  program*  There  was 

no  significant  difference  in  the  amount  learned  by  the  high  or  low 
t  n  27 

I.Q.  groups. 

Krumboltz,  using  undergraduate  and  graduate  college  students, 

compared  key-word  response  in  programmed  instruction  with  the  reading 

of  the  same  material  in  paragraph  form  with  no  required  response. 

2  8 

He  found  no  significant  differences  on  the  post-test. 


Training  Standards  and  Development  Division  of  the  Radar  and 
Communications  School,  "An  Evaluation  of  Programmed  Instruction  in 
Elementary  Mathematics,"  (published  report)  1963. 

27 

W.  R.  Unruh,  "An  Investigation  of  Four  Methods  of  Pre¬ 
sending  Programmed  Material,"  Unpublished  Master’s  Thesis,  The 
University  of  Alberta,  1962. 

2  8 

J.  D.  Krumboltz,  "The  Nature  and  Importance  of  the  Required 
Response  in  Programmed  Instruction,"  Report  to  American  Educational 
Research  Association  (Chicago,  February,  1963)  mimeographed. 
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In  a  similar  experiment  at  the  college  level  Evans  compared 

a  programmed  text  with  a  conventional  text.  Three  topics  —  number 

bases,  statistics,  and  music  —  were  used.  The  post-test  scores 

were  higher  for  those  using  the  programmed  text  but  only  were  signi- 

29 

ficant  for  the  topic  in  music. 

Research  with  different  intelligence  levels .  There  are 
conflicting  results  in  determining  the  relationship  of  intelligence 
to  success  in  programmed  instruction. 

Feldhusen  found  that  I.Q.  was  not  a  fundamental  learning  vari¬ 
able  and  that  the  variance  in  learning  attributed  to  I„Q.  seemed 

30 

less  important  than  that  attributed  to  general  achievement  level. 

On  the  other  hand,  Lambert,  using  a  program  on  modem  mathe¬ 
matics  for  ninth  graders,  reported  that  intelligence  was  signifi¬ 
cantly  associated  with  the  amount  of  information  acquired  from  the 
31 

program. 
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J.  L.  Evans,  R.  Glaser,  and  L.  E.  Homme,  "An  Investigation 
of  Variation  in  the  Properties  of  Verbal  Learning  Sequence  of  the 
’Teaching  Machine  Type’ ,"  Teaching  Machines  and  Programmed  Learning : 
A  Source  Book  (Washington,  D.C.:  Department  of  Audio-Visual 
Instruction,  National  Education  Society,  1960),  pp.  446-461. 

30 

J.  F.  Feldhusen  and  A.  Birt,  "A  Study  of  Nine  Methods  of 
Programmed  Learning  Materials,"  Journal  of  Educational  Research, 

55  (1962),  pp.  461-466. 
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P.  Lambert,  D.  M.  Miller,  and  D.  E.  Wiley,  "Experimental 
Folklore  and  Experimentation:  The  Study  of  Programmed  Learning  in 
the  Wauwatosa  Public  Schools,"  Journal  of  Educational  Research. 

515  (1962),  pp.  485-494. 


. 


. 


30 


Research  with  use  of  programmed  materials .  There  is  evidence 

that  programmed  material  is  being  used  in  the  classroom  for  enrich- 

32 

ment  nearly  as  much  as  for  any  other  single  purpose.  However, 

Bale  states  that: 

Although  programmed  instruction  is  popular  its  superiority  is 
unproved.  A  basic  program  of  enrichment  with  materials  or 
activities  varied  to  suit  the  different  types  of  potentially 
talented  mathematics  students  is  needed.  An  experimental  study 
of  various  materials  or  activities  such  as  programmed  text 
versus  conventional  text  may  indicate  the  kind  of  enrichment 
differentiation  needed. 33 

Garrison  studied  the  effectiveness  of  programmed  material  as 
a  supplement  of  elementary  algebra  over  several  ability  levels.  One 
group  studied  programmed  materials  using  a  teaching  machine  during 
class  time  for  15  minutes  each  day  at  their  own  rate.  A  second  group 
did  the  same,  but  did  so  after  regular  school  hours.  The  third  group, 
the  control  group,  continued  in  their  usual  fashion  in  the  regular 
class.  Each  group  contained  high,  average,  and  low  intelligence 
levels  of  students.  The  high  ability  students  used  the  machines 
more  than  the  other  two  levels  of  students.  The  group  which  used 
regular  class  time  for  the  program  achieved  better  results,  but  the 


32 

A  Survey  of  the  Use  of  Programmed  Instruction  in  Canadian 
Schools,  1962-63  (Research  Memo  No.  12,  Ottawa  Research  Division, 
Canadian  Teachers'  Federation,  September,  1963). 

33 

D.  J.  Bale,  "A  Comparison  of  Programmed  and  Conventional 
Mathematics  Enrichment  Materials  over  Two  Grade  Seven  Mathematics 
Achievement  Levels,"  Unpublished  Master's  Thesis,  The  University  of 
Alberta,  1966. 
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difference  was  not  significant  at  the  0.05  level  of  confidence. 
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Lane  investigated  the  use  of  programmed  instruction  as  a 
supplement  to  teaching  college  mathematics  by  closed-circuit 
television.  Students  enrolled  in  "Fundamental  Principels  of  Mathe¬ 
matics"  at  the  Nashville  College  for  Teachers  were  assigned  at  ran¬ 
dom  to  one  of  three  treatment  groups.  Each  group  watched  the  same 
televised  lecture.  Group  I  viewed  a  kinescope  film  of  the  solutions 
of  the  homework  exercises.  Group  II  participated  in  a  classroom 
help  session.  Group  III  studies  a  programmed  booklet  based  on  the 
assigned  exercises.  After  twelve  class  meetings,  the  students  were 
given  an  achievement  test.  On  the  basis  of  the  analysis  the 
following  conclusions  were  drawn: 

1.  The  programmed  material  provided  a  supplement  to  tele¬ 
vised  instruction  which  was  more  effective  than  either  of  the  other 
two  supplementary  methods. 

2.  The  classroom  discussion  and  the  kinescope  film  session 
appeared  to  be  equally  effective. 

3.  The  experiment  showed  validation  of  the  programmed  book- 

35 

let  as  a  method  of  instruction  for  the  material  which  it  covers. 

3  A 

N.  Garrison,  "Effectiveness  of  Programmed  Material  As  A 
Supplement  for  Elementary  Algebra  over  Several  Ability  Levels." 


35 

B.  R.  Lane,  "An  Experiment  with  Programmed  Instruction  as 
a  Supplement  to  Teaching  College  Mathematics  by  Closed  Circuit 
Television,"  The  Mathematics  Teacher,  LVII  (October,  1964),  pp.  395-397. 
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V.  CONCLUSIONS 

There  can  be  no  doubt  that  the  programmed  instruction  move¬ 
ment  has  provided  the  impetus  for  reconsidering,  as  well  as  the  ideas 
for  implementing,  a  number  of  time-honored  principles  of  learning. 
Renewed  interest  in  effecting  more  well-directed  student  participa¬ 
tion  in  the  learning  process  is  a  case  in  point. 

Essentially,  programmed  instruction  is  a  self- teaching  device. 
The  device  itself  may  be  a  teaching  machine,  a  programmed  text,  or 
a  notebook  with  the  following  principles  in  common: 

1.  Material  is  presented  in  small  sequential  steps  which 
require  the  student  to  respond. 

2.  The  student  must  make  a  response  ...  be  it  writing  or 
pressing  a  mechanical  device  signifying  an  answer. 

3.  The  response  must  be  reinforced.  It  is  a  self-scoring 
device  and  may,  as  in  branching  programs,  even  tell  the  student 
why  he  is  wrong  and  show  him  how  the  correct  answer  can  be  found. 

4.  It  is  self-pacing  in  that  students  determine  the  speed  of 
presentation. 

Construction  of  programs  requires  the  observance  of  two 
basic  requirements: 

1.  Before  preparing  a  program  it  is  necessary  to  formulate, 
as  precisely  as  possible,  statements  of  the  desired  objectives  of 


the  program. 
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2,  The  program  is  not  complete  until  the  writer  is  assured 
.  .  .  through  testing  .  .  .  that  the  program  does,  in  fact,  teach 
what  it  is  supposed  to  teach. 

Generalizing  over  a  wide  range  of  subject  matter,  the  evi¬ 
dence  indicates  that  anything  that  can  be  tested  can  be  programmed 
and  conversely  anything  that  can  be  programmed  can  be  tested.  The 
evidence  also  indicates  that  students  can  be  taught  as  efficiently 
by  programmed  instruction  as  they  can  by  the  conventional  classroom 
presentation.  These  studies,  as  a  group,  are  not  characterized  by 
sophisticated  experimental  design  nor  by  scrupulous  control  of 
extraneous  variables.  However,  the  majority  of  them  did  employ 
some  form  of  statistical  test  to  test  the  significance  of  differ¬ 
ences  among  groups  on  criterion  test  scores. 

A  large  and  promising  area  of  exploration  grows  out  of  the 
exploding  interest  in  recent  years  in  the  use  of  films,  television, 
and  other  such  media  for  the  purpose  of  instruction. 


.  ] 
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CHAPTER  III 


THE  EXPERIMENTAL  DESIGN  AND  THE  STATISTICAL  PROCEDURES 

The  purpose  of  this  study  was  to  compare  experimentally  the 
effectiveness  of  a  programmed  text  used  during  class  time  with  the 
conventional  method  of  teaching  logarithms  to  Mathematics  20  stu¬ 
dents  . 

This  chapter  contains  a  detailed  description  of  the  sample 
and  the  materials  used  in  the  experiment,  the  achievement  tests, 
the  design  of  the  experiment  and  the  procedures  followed  in  pro¬ 
cessing  the  data. 


I.  THE  NATURE  OF  THE  SAMPLE 

The  study  was  conducted  during  the  spring,  1965.  Permission 
was  granted  by  the  administration  of  the  Edmonton  Separate  Schools 
to  use  pupils  of  their  system.  Those  teachers  who  taught  two 
classes  of  Mathematics  20  were  asked  to  co-operate.  This  provided 
ten  classes  .  .  .  two  from  each  of  five  high  schools  .  .  .  and 
five  teachers.  Since  most  of  the  students  were  girls,  the  data 
required  for  the  study  was  limited  to  them.  Total  and  Verbal 
scores  were  obtained  from  Department  of  Education  records  as 
established  by  a  SCAT  test  written  by  the  students  at  the  time 


they  wrote  the  grade  IX  departmental  examinations  (1963) .  With 
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these  conditions  set,  the  experimental  population  amounted  to  175 
students.  The  sample  was  divided  into  two  treatment  groups  by 
random  assignment  and  each  group  in  turn  was  subdivided  into  two 
categories.  This  subdivision  was  determined  in  two  different  ways: 

a)  on  the  basis  of  Total  SCAT  scores,  and 

b)  on  the  basis  of  Verbal  SCAT  scores  only. 

The  unit  on  logarithms  was  selected  for  the  study  because 
for  the  first  time  it  was  included  as  part  of  the  course  outline 
for  Mathematics  20.^ 


II.  THE  NATURE  OF  THE  MATERIALS 

Programmed  materials  are  different  from  ordinary  instructional 
materials  in  that  they  are  specifically  designed  to  enable  students 
to  learn  specific  areas  of  course  content  in  a  self-instructional 
manner  through  interaction  with  the  materials.  Consequently,  these 
materials  accept  considerably  more  responsibility  for  bringing 
about  learning  than  ordinary  textbooks,  which  traditionally  have 
performed  the  function  of  supplying  the  teacher  with  material  from 
which  to  teach  rather  than  supplying  the  learner  with  materials 
from  which  to  learn. 

In  the  review  of  the  literature  it  is  stressed  that  mere 
availability  of  a  program  is  no  guarantee  of  quality.  The 

"''Alberta  Senior  High  School  Mathematics  Subcommittee, 

Senior  High  School  Curriculum  Guide  for  Mathematics  10  and 
Mathematics  20,  September,  1963,  p.  25.  (pamphlet) 
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effectiveness  of  programs  as  teaching  instruments  will  vary  from 
highly  effective  to  extremely  poor,  depending  on  the  thoroughness 
of  each  particular  program's  development. 

The  initial  step  in  the  process  of  program  development  is 
to  establish  specific  objectives  for  the  program.  These  are 
stated  in  terms  of  what  the  student  should  be  able  to  do  when  he 
completes  the  program.  Next,  the  program  criterion  must  be  estab¬ 
lished.  This  asks:  how  well  must  the  learner  be  able  to  perform? 
Then  a  valid  achievement  test  must  be  constructed  to  serve  as  an 
instrument  in  measuring  the  actual  level  of  performance. 

In  the  next  step,  the  entire  field  of  subject  matter  is 
carefully  analyzed  to  determine  what  is  necessary  for  the  students 
to  learn  in  order  to  acquire  the  pre-determined  behaviors.  Once 
this  body  of  subject  matter  is  identified,  it  is  ordered  in  a 
logical,  well-sequenced  progression  in  order  to  lead  the  student 
to  the  desired  behaviors.  These  are  tried  and  tested  on  individ¬ 
uals  or  small  groups,  representative  of  the  target  population. 

This  try-out  is  designed  to  eliminate  the  major  weaknesses  in  the 
program.  During  the  field  testing,  elimination  of  weaknesses 
and  revisions  continue  until  all  obvious  patterns  of  weakness 
are  eliminated  or  until  the  pre-determined  level  of  effective's 
is  reached. 

This  procedure  of  development  was  followed  in  the  construc¬ 
tion  of  the  programmed  text  materials  used  in  this  study.  During 
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1962  approximately  one  thousand  individuals  were  involved  in  the 
testing  and  revisions  that  were  required  in  this  regard.  The  co¬ 
operation  of  the  Training  Standards  and  Development  Division  of  the 
Radar  and  Communication  School  of  the  Royal  Canadian  Air  Force  in 
providing  the  programmed  text  materials  is  gratefully  acknowledged. 
The  material  was  compiled  in  250  frames  utilizing  the  linear 
(extrinsic)  method  of  presentation.  Frame  (1)  was  presented  on 
page  one;  frame  (2)  and  the  answer  to  frame  (1)  were  presented 
on  the  next  page  and  so  on.  Eventually  students  were  directed 
back  to  page  one  for  the  next  frame  and  the  answer  to  the  previous 
frame.  This  pattern  was  continued  until  all  the  pages  were  filled. 

In  addition,  drill  exercises  were  provided,  to  be  done  at 
the  conclusion  of  specified  frames  to  reinforce  concepts  presented 
in  that  series  of  frames.  Other  drill  exercises  were  available 
for  those  students  who  completed  the  program  ahead  of  their  class¬ 
mates  . 

The  investigator  felt  that  the  programmed  text  material  was 

a  fair  representation  of  the  materials  on  this  unit  in  the  auth- 
2 

orized  text. 


III.  THE  TESTING  INSTRUMENTS 


The  scores  used  in  this  study  were  determined  from: 


2 

Bowers,  Miller,  and  Rourke,  Mathematics  for  Canadians, 
Book  3  (J.  M.  Dent  and  Sons  and  the  Macmillan  Company  of  Canada, 

1950),  Chapter  XIII,  pp.  292-319. 


' 
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a)  School  and  College  Ability  Tests  (SCAT) . 

b)  The  Cooperative  High  School  Mathematics  Tests .  Inter¬ 
mediate  Algebra  (Quadratics  and  Beyond)  ,  Forms  Y_  and  Z_. 

c)  Logarithm  Retention  Test . 

The  purpose  of  the  Cooperative  School  and  College  Ability  Tests 
(SCAT)  is  to  evaluate  the  students'  capacity  to  perform  academic 
tasks  at  the  next  higher  school  level.  SCAT  measures  developed 
ability  in  Verbal  and  Quantitative  skills  and  also  yields  a  Total 
score.  Individual  performance  is  interpreted  by  means  of  converted 
scores  and  percentile  bands.  This  test  was  made  available  by  the 
Department  of  Education  and  was  administered  to  the  students  at  the 
time  they  were  writing  the  departmental  examinations  in  grade  IX. 

If  the  Total  and  Verbal  scores  were  available  those  students  were 
included  in  the  study.  These  scores  determined  the  high  (HI)  and 

low  (LO)  categories  in  the  two  treatment  groups. 

3 

The  Cooperative  Test  Division  has  followed  the  developments 
in  mathematics  and  has  taken  the  major  trends  into  consideration 
in  planning  tests  and  revising  existing  instruments.  Some  of  the 
newer  emphases  in  language  and  content  can  be  found  in  these  tests, 
but  in  the  main  important  aspects  of  traditional  mathematics  con¬ 
tinue  to  be  measured.  Intermediate  Algebra  (Quadratics  and  Beyond) 
consists  of  a  combination  of  discrete  items  and  sets  which  require 
a  knowledge  of  terms  and  concepts  as  well  as  problem  solving. 


Educational  Testing  Service,  Cooperative  Intermediate  Algebra 
Test  (Quadratics  and  Beyond).  (Princeton:  Cooperative  Test  Division, 
Educational  Testing  Service) . 
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Forms  Y_  and  Z_  were  used  as  the  pre-test  and  post-test  respectively. 
Scores  on  the  forms  are  comparable  because  of  the  system  of  Scaled 
Scores  which  was  developed  for  the  Cooperative  tests.  The  raw  scores 
are  converted  to  Scaled  Scores  by  means  of  published  tables. 

There  was  no  documented  evidence  as  to  the  validity  and  re¬ 
liability  of  the  logarithm  Retention  Test  which  was  used  to  determine- 
the  retention  of  the  subject  matter  presented  to  both  groups.  The 
test  was  available  in  the  school  library.  In  the  opinion  of  the 
teachers  concerned  and  other  teachers  who  used  the  test,  it  served 
as  a  fair  measure  of  achievement. 

IV.  PROCEDURE 

Testing  Program.  The  Cooperative,  High  School  Mathematics 
Test :  Intermediate  Algebra  (Quadratics  and  Beyond)  Form  Y,  was 
administered  as  a  pre-test  to  all  the  students  in  the  experimental 
classes.  Each  teacher  administered  the  tests  to  his  or  her  own 
classes  according  to  the  uniform  instructions  provided.  All  the 
test  papers  were  collected  immediately  and  scored  by  the  investi¬ 
gator  . 

Two  weeks  later  the  same  test,  Form  Z_  was  administered  as 
a  post-test  to  all  the  students  in  the  experimental  classes  immed¬ 
iately  following  the  instruction  of  the  unit.  Each  teacher  gave  the 
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the  post-test  under  conditions  as  similar  as  possible  to  those 
under  which  the  pre-test  was  administered.  Again,  the  test  papers 
were  collected  immediately  and  scored  by  the  investigator. 

Three  weeks  after  the  post- test  was  administered  the 
Logarithm  Retention  Test  was  given  by  the  teachers  according  to  the 
uniform  instructions  provided.  Once  again,  the  test  papers  were 
marked  by  the  investigator. 

Teacher  Procedure.  One  of  the  classes  belonging  to  each 
teacher  was  randomly  designated  as  a  control  group  (CON)  class  and 
the  other  class  became  a  programmed  instruction  group  (PROG)  class. 

The  PROG  group  was  issued  the  programmed  instruction  mater¬ 
ials  and  was  briefed  by  their  teacher  regarding  the  use  of  these 
materials.  They  were  instructed  to  use  the  materials  during  the 
regular  class  periods  only  and  to  turn  in  the  materials  at  the  end 
of  each  period.  They  were  urged  to  read  and  follow  the  instruc¬ 
tions  carefully  because  the  teacher  would  only  be  involved  in  a 
supervisory  capacity. 

In  teaching  the  CON  group,  the  teachers  were  asked  to  use 
a  method  of  presentation  which  would  conform  closely  with  the  sug¬ 
gested  procedures  in  the  authorized  textbook. 

Since  the  study  was  conducted  in  a  practical  school  situa¬ 
tion  it  was  not  possible  to  have  made  a  random  assignment  of  pupils, 
teachers  and  treatments.  However,  every  attempt  was  made  to  keep 
other  variables  as  nearly  constant  as  possible.  Data  on  the 


xi 
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characteristics  of  the  teachers  involved  in  the  study  were  collected. 
This  information  is  presented  in  the  next  chapter. 

At  the  conclusion  of  the  study  the  PROG  group  was  asked  to 
complete  a  questionnaire  which  was  prepared  by  the  investigator. 

The  summary  of  this  questionnaire  is  also  presented  in  the  next 
chapter. 

V.  TREATMENT  OF  THE  DATA 

A  binary-coded  punched  data  card,  containing  ICD.  numbers  and 
test  scores,  was  prepared  for  each  student.  Permission  was  granted 
by  the  University  of  Alberta  Computing  Centre  to  use  their  facilities 
to  process  the  data  in  order  to  make  statistical  tests. 

i 

Sfnce  rigorous  experimental  controls  on  the  characteristics 
of  the  group  could  not  be  employed,  the  first  consideration  was  to 
test  for  significant  differences  between  the  groups.  The  groups 
were  each  divided  in  two  ways,  first,  into  scholastic  ability 
levels  in  order  that  the  effects  of  the  different  treatments  on 
students  of  different  scholastic  abilities  could  be  assessed,  anc| 
secondly,  into  two  verbal  ability  levels,  in  order  that  the  effects 
of  the  different  treatments  on  students  of  different  verbal  abilities 
could  be  assessed. 

The  frequency  distribution  for  each  basis  was  established 
and  then  arbitrarily,  the  groups  were  divided  into  two  categories. 

To  illustrate:  on  the  basis  of  the  Total  SCAT  scores,  a  student 


with  a  score  of  71  or  above  was  classified  as  scoring  in  the  upper 
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half  of  the  scholastic  ability  range  (HI) ,  and  one  whose  score  was 
70  or  less  was  classified  as  scoring  in  the  lower  half  of  the  schol 
astic  ability  range  (LO) ,  Thus  each  student  was  classified  by  treat 
ment  as  CON  or  PROG  and  by  scholastic  ability  as  HI  or  LO.  The 
number  of  students  classified  in  each  cell  is  indicated  in  Table  I. 

Another  division  of  the  groups  was  made  on  the  basis  of.  . 
Verbal  SCAT  scores,  using  a  score  of  stanine  7  and  above  for  the 
upper  level  (HI) ,  and  a  score  of  stanine  6  or  less  for  the  lower 
level  (LO) .  Each  student  was  again  classified  by  treatment  as  CON 
or  PROG  and  by  verbal  ability  as  HI  or  LO.  The  number  of  students 

classified  in  each  cell  is  indicated  in  Table  II. 

4 

A  chi  square  test  carried  out  on  the  cell  frequencies  in 
Table  I  and  II  showed  that  they  were  not  significantly  different 
from  being  proportional  to  the  row  and  column  totals. 

Since  it  was  observed^  that  there  was  no  significant  dif¬ 
ference  between  the  means  of  pre-test  scores  obtained  by  the  CON 
and  PROG  groups  it  was  considered  appropriate  to  utilize  the  com¬ 
putational  procedures  for  a  two-way  unweighted  means  analysis  of 
variance  to  test  the  following  null  hypotheses: 

1.  There  is  no  significant  difference  between  the  mean  post¬ 
test  Cooperative  Intermediate  Algebra  Scores  obtained  by: 

4 

Details  given  in  the  Appendix. 

^Chapter  IV  of  this  study. 

^B.  J.  Winer,  Statistical  Principles  in  Experimental  Design 
(New  York:  McGraw-Hill  Book  Company,  1962),  p.  93. 
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TABLE  I 

CELL  FREQUENCIES  FOR  INSTRUCTIONAL  GROUPS  AND 
SCHOLASTIC  ABILITY  LEVEL  CLASSIFICATION 


GROUP 

VERBAL 

HI 

SCAT  SCORE 

LO 

\ 

TOTAL 

CON 

40 

56 

96 

PROG 

47 

32 

79 

TOTAL 

87 

88 

175 

TABLE  II 

CELL  FREQUENCIES  FOR  INSTRUCTIONAL  GROUPS  AND 
VERBAL  ABILITY  LEVEL  CLASSIFICATION 


GROUP 

VERBAL 

HI 

SCAT  SCORE 

LO 

TOTAL 

CON 

34 

62 

96 

PROG 

34 

45 

79 

TOTAL 

68 

107 

175 

a)  the  CON  and  PROG  groups , 

b)  the  HI  and  LO  scholastic  ability  (total;  verbal) 
groups . 

2.  There  is  no  significant  difference  between  the  mean 

Logarithm  Retention  Scores  obtained  by: 

a)  the  CON  and  PROG  groups , 

b)  the  HI  and  LO  scholastic  ability  (total;  verbal) 
groups . 

Whenever  statistical  tests  on  the  differences  between  means 
were  carried  out,  0.01  level  critical  value  was  used.  Consequently, 
the  conclusions  reached  in  this  report  on  the  basis  of  statistical 
tests  are  relatively  conservative  since  the  probability  of  indi¬ 
cating  a  significant  difference  between  means  as  a  result  of 
sampling  error  is  only  0.01. 

Summary .  The  present  chapter  has  been  a  description  of  the 
nature  of  the  components  of  the  experiment,  of  the  experimental 
design  and  the  statistical  procedures  followed  in  analyzing  the 
data.  The  next  chapter  presents  the  results  of  the  analysis  of 


the  data. 


CHAPTER  IV 


THE  RESULTS  OF  THE  INVESTIGATION 

I.  COMPARISON  OF  GROUPS  BEFORE  TREATMENT 

The  first  consideration  was  to  test  for  significant  dif¬ 
ferences  between  the  two  treatment  groups  with  respect  to  initial 
achievement  mean  scores.  An  analysis  was  carried  out  to  test  that: 

There  is  no  significant  difference  between  the  mean  pre-test 
Co-operative  Intermediate  Algebra  scores  obtained  by: 

a)  the  CON  and  PROG  groups, 

b)  the  HI  and  LO  scholastic  ability  (total)  groups. 

Table  III  lists  the  pre-test  cell  means  and  the  results  of 

the  analysis  are  summarized  in  Table  IV. 

Inspection  of  the  F-ratios  in  Table  IV  shows  that  there  is 
no  significant  difference  between  the  mean  scores  obtained  by  the 
two  treatment  groups.  The  observed  F-ratio  (0.055)  did  not  exceed 
the  critical  value  (6.71). 

Further,  the  observed  F-ratio  (0.11)  attributed  to  inter¬ 
action  did  not  exceed  the  critical  value  (6.71)  so  the  interaction 
effect  was  not  statistically  significant. 

The  students  in  the  HI  scholastic  ability  level  scored  highe 
than  the  students  in  the  LO  scholastic  ability  level.  The  observed 
F-ratio  (31.65)  exceeded  the  critical  value  (6.71).  This  was  a 
reasonable  result  to  expect. 
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TABLE  III 

PRE-TEST  CELL  MEANS 

CELLS  DETERMINED  BY  TOTAL  SCAT 
(PERCENTILE  SCORES) 


HI 

LO 

GROUP  MEAN 

CON 

57.32 

53.11 

54.86 

PROG 

57.79 

53.03 

55.86 

Grand  Mean 

55.31 

Pre-test:  Intermediate  Algebra  (Quadratics  and  Beyond)  Form  Y 


TABLE  IV 


SUMMARY  OF  ANALYSIS  OF  VARIANCE 
OF  PRE-TEST  SCORES 


SOURCE 

SS 

DF 

MS 

F 

A  (Ability) 

844.29 

1 

844.29 

31.65 

B  (Group) 

1.47 

1 

1.47 

0.055 

AB  (Interaction) 

2.95 

1 

2.95 

0.11 

Within 

4561.1 

171 

26.67 

Ability  Levels: 

TOTAL  SCAT 

SCORES 

Pre-test:  Intermediate  Algebra  (Quadratics  and  Beyond)  Form  Y. 


Ft0l  (1,171)  =  6.71 


* 
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An  analysis  was  also  carried  out  to  test  that: 

There  is  no  significant  difference  between  the  mean  pre¬ 
test  Co-operative  Intermediate  Algebra  scores  obtained  by: 

a)  the  CON  and  PROG  groups, 

b)  the  HI  and  LO  scholastic  ability  (verbal)  groups. 

Table  V  lists  the  pre-test  cell  means  and  the  results  of  the 
analyses  of  variance  are  summarized  in  Table  VI. 

Inspection  of  the  F-ratios  in  Table  VI  shows  that  there  is 
no  significant  difference  between  the  mean  scores  obtained  by  the 
two  treatment  groups.  The  observed  F-ratio  (0.76)  did  not  exceed 
the  critical  value  (6.71) 

The  effect  of  interaction  was  not  statistically  significant 
because  the  observed  F-ratio  (-0.01)  did  not  exceed  the  critical 
value  (6 . 71) . 

Again,  the  students  in  the  HI  verbal  ability  level  scored 
higher  than  the  students  in  the  LO  verbal  ability  level.  The  ob¬ 
served  F-ratio  (17.78)  exceeded  the  critical  value  (6.71).  However, 
this  was  a  reasonable  result  to  expect. 

The  computational  procedure  for  the  unweighted  means  analysis 
of  variance  as  described  by  Winer^  and  programmed  for  use  with  the 
University  of  Alberta's  computer,  was  made  available  to  the 

^B.  j.  Winer,  Statistical  Principles  in  Experimental  Design 
(Edition  II)  (New  York:  McGraw-Hill  Book  Company,  Inc.,  1962), 
pp.  241-244. 
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TABLE  V 

PRE-TEST  CELL  MEANS 


CELLS 

DETERMINED 

BY  VERBAL  SCAT 

SCORES 

HI 

LO 

GROUP  MEAN 

CON 

57.15 

53.61 

54.86 

PROG 

57.85 

54.36 

55.86 

Grand  Mean 

55.32 

Pre-Test:  Intermediate  Algebra  (Quadratics  and  Beyond)  Form  Y 
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TABLE  VI 

SUMMARY  OF  ANALYSIS  OF  VARIANCE 

OF  PRE-TEST  SCORES 


SOURCE 

SS 

DF 

MS 

F 

A  (Ability) 

508.91 

1 

508.91 

17.78 

B  (Group) 

21.71 

1 

21.71 

0.76 

AB  (Interaction) 

-0.32 

1 

-0.32 

-0.01 

Within 

4895.69 

171 

28.63 

Ability  Levels: 

VERBAL  SCAT 

SCORES 

Pre-test:  Intermediate  Algebra  (Quadratics  and  Beyond)  Form  Y. 


(1,171)  =  6.71 


51 


investigator  to  carry  out  tests  of  null  hypotheses. 

II.  COMPARISON  OF  GROUPS  AFTER  TREATMENT 

Procedure .  Each  of  the  null  hypotheses  tested  is  stated 
immediately  before  the  presentation  of  the  results  of  the  appro¬ 
priate  statistical  tests. 

Null  Hypothesis  1.  There  is  no  significant  difference 
between  the  mean  post-test  Co-operative  Intermediate 
Algebra  scores  obtained  by: 

a)  the  CON  and  PROG  groups, 

b)  the  HI  and  LO  scholastic  ability  (total;  verbal) 
groups . 

Tables  VII  and  VIII  list  the  post-test  cell  means  and 
Tables  IX  and  X  summarize  the  analysis  of  variance  carried  out  on 
the  post-test  scores. 

Conclusions .  Examination  of  Tables  IX  and  X  and  the 
critical  F-ratio  led  to  the  following  decisions: 

Null  Hypothesis  1-a  was  accepted. 

Null  Hypothesis  1-b  was  rejected. 

Interpretations .  There  was  no  significant  difference  between 
the  two  treatment  groups  post-test  mean  scores.  The  interaction 
effect  in  all  cases  was  not  statistically  significant. 

The  students  in  the  higher  ability  range  (HI)  scored  signi¬ 
ficantly  higher  than  the  students  in  the  lower  ability  level  (LO) . 

2 

See  page  42. 
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TABLE  VII 

POST-TEST  CELL  MEANS 

CELLS  DETERMINED  BY  TOTAL  SCAT 
(PERCENTILE  SCORES) 


HI 

LO 

GROUP  MEANS 

CON 

59.17 

54.50 

56.44 

PROG 

59.23 

54.59 

57.35 

Grand  Mean 

56.86 

Post-test:  Intermediate  Algebra  (Quadratics  and  Beyond)  Form  Z 


TABLE  VIII 


POST-TEST  CELL  MEANS 

CELLS  DETERMINED  BY  VERBAL  SCAT  SCORES 


HI 

LO 

GROUP  MEAN 

CON 

58.59 

55.27 

56.45 

PROG 

59.32 

55.87 

57.35 

Grand  Mean 

56.86 

Post-test:  Intermediate  Algebra  (Quadratics  and  Beyond)  Form  Z 
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TABLE  IX 

SUMMARY  OF  ANALYSIS  OF  VARIANCE 

OF  POST-TEST  SCORES 


SOURCE 

SS 

DF 

MS 

F 

A  (Ability) 

909.81 

1 

909.81 

48„  08 

B  (Group) 

0.164 

1 

0.164 

0.01 

AB  (Interaction) 

0.00 

1 

0.00 

0.00 

Within 

3236.00 

171 

18.92 

Ability  Levels: 

TOTAL  SCAT 

SCORES 

Post-test:  Intermediate  Algebra  (Quadratics  and  Beyond)  Form  Z. 

F<01  (1,171)  =  6.71 
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TABLE  X 

SUMMARY  OF  ANALYSIS  OF  VARIANCE 

OF  POST-TEST  SCORES 


SOURCE 

SS 

DF 

MS 

F 

A  (Ability) 

471.77 

1 

471.77 

21.90 

B  (Group) 

18.17 

1 

18.17 

0.84 

AB  (Interaction) 

0.16 

1 

0.16 

0.01 

Within 

3683.38 

171 

21.54 

Ability  Levels:  VERBAL  SCAT  SCORES 

Post-test:  Intermediate  Algebra  (Quadratics  and  Beydnd)  Fora  Z, 


F 


01 


(1,171)  =  6.71 
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Null  Hypothesis  2.  There  is  no  significant  difference 
between  the  mean  Logarithm  Retention  Scores  obtained 
by : 

a)  the  CON  and  PROG  groups, 

b)  the  Hi  and  LO  scholastic  ability  (total;  verbal) 
groups . 

Tables  XI  and  XII  list  the  post-test  cell  means  and  Tables 
XIII  and  XIV  summarize  the  analysis  of  variance  carried  out  on  the 
retention  scores. 

Conclusions .  Examination  of  Tables  XII  and  XIV  and  the 
critical  F-ratio  led  to  the  following  decisions: 

Null  Hypothesis  2-a  was  accepted. 

Null  Hypothesis  2-b  was  rejected. 

Interpretations .  There  was  no  significant  difference  between 
the  two  treatment  groups'  mean  retention  scores.  The  interaction 
effect  in  all  cases  was  not  statistically  significant. 

As  was  expected,  the  students  in  the  higher  ability  range 
(HI)  scored  significantly  higher  than  the  students  in  the  lower 
ability  level  (LO) . 

III.  SUMMARY  OF  OTHER  FINDINGS 

Teacher  Characteristics .  Although  it  is  difficult  to  rate 
a  teacher's  effectiveness  on  the  basis  of  university  course  back¬ 
ground  and  on  the  number  of  years  of  teaching  experience,  this 
information  was  sought  when  the  teachers  were  interviewed.  There 
were  only  five  teachers  involved  in  the  experiment  because  each 
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TABLE  XI 

RETENTION-TEST  CELL  MEANS 

CELLS  DETERMINED  BY  TOTAL  SCAT 
(PERCENTILE)  SCORES 


HI 

LO 

GROUP  MEAN 

CON 

4.90 

4.14 

4.46 

PROG 

5.47 

3.13 

4.52 

Grand  Mean 

4.49 
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TABLE  XII 

RETENTION-TEST  CELL  MEANS 

CELLS  DETERMINED  BY  VERBAL  SCAT  SCORES 


HI 

LO 

GROUP  MEAN 

CON 

5.09 

4.11 

4.46 

PROG 

5.62 

3.69 

4.52 

Grand  Mean 

4.49 
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TABLE  XIII 

SUMMARY  OF  ANALYSIS  OF  VARIANCE 
OF  RETENTION-TEST 


SOURCE 

SS 

DF 

MS 

F 

A  (Ability) 

100.77 

1 

100.77 

17.37 

B  (Group) 

2.12 

1 

2.12 

0.37 

AB  (Interaction) 

26.37 

1 

26.37 

4.55 

Within 

991.66 

171 

5.80 

Ability  Levels: 

TOTAL  SCAT 

SCORES 

F.oi  (1’ 

171)  =  6.71 

SUMMARY  OF 

OF 

TABLE  XIV 

ANALYSIS  OF  VARIANCE 

RETENTION-TEST 

SOURCE 

SS 

DF 

MS 

F 

A  (Ability) 

86.79 

1 

86.79 

14.60 

B  (Group) 

0.12 

1 

0.12 

0.20 

AB  (Interaction) 

9.35 

1 

9.35 

1.57 

Within 

1016.62 

171 

5.95 

Ability  Levels: 

VERBAL  SCAT  SCORES 

F 


.01 


(1,171)  =  6.71 
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was  associated  with  one  control  and  one  experimental  class.  The 
information  gathered  in  the  interviews  indicated  that  the  teacher 
training  varied  from  four  to  five  years  of  university  education 
and  teaching  experience  ranged  from  3  to  6  years.  No  teacher  had 
any  special  training  or  experience  in  the  teaching  of  logarithms. 

Time  Factor .  The  length  of  time  required  for  the  experimental 
group  (PROG)  to  complete  the  program  coincided  closely  with  the  time 
required  to  teach  the  unit  in  the  traditional  classroom  method  to 
the  control  group  (CON) .  The  time  required  for  the  completion  of 
the  experiment  was  two  weeks  and  three  additional  class  periods 
to  write  the  tests.  Further,  the  experimental  group  was  provided 
with  additional  drill-type  problems  in  lieu  of  assignments  and  to 
also  control  the  time  factor  within  the  group. 

Student  Questionnaire .  The  students  in  the  PROG  group  were 
asked  to  complete  a  questionnaire  and  to  make  comments  concerning 
programmed  instruction.  They  were  encouraged  to  give  their  views 
on  features  of  programmed  instruction  they  liked  and  disliked.  A 
summary  of  these  remarks  follows: 

1.  The  majority  expressed  approval  of  the  facility  to  work 
at  their  own  speed  and  particularly  when  proceeding  through  dif¬ 
ficult  material. 

2.  Many  students  would  prefer  a  mixture  of  programmed  instruc¬ 
tion  and  conventional  teaching. 
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3.  Many  stated  they  would  like  to  use  programmed  material 
and  at  the  same  time  be  able  to  ask  questions  and  discuss  difficult 
points  with  the  teacher. 

4.  The  students  were  divided  on  the  point  of  whether  more 
review  should  be  included  in  the  booklet. 

5.  The  feature  most  students  disliked  was  the  boredom  of 
"turning  pages"  all  the  time.  This  was  considered  a  waste  of  time. 

A  summary  of  the  questionnaire  is  presented  in  Table  XV. 

IV .  CHAPTER  SUMMARY 

In  all  cases  in  the  treatment  of  the  data  from  the  experiment, 
the  differences  between  two  means  was  considered  to  be  statistically 
significant  only  if  the  probability  of  observing  such  a  difference  as 
a  result  of  sampling  error  was  0.01  or  less. 

For  all  comparisons  made  between  HI  and  LO  ability  levels,  the 
results  from  a  two-way  analysis  of  variance  revealed  significant 
differences  at  the  0.01  level  on  the  post-test  and  the  retention  test. 
This  evidence  was  expected.  The  conclusions  were  the  same  whether 
the  two  levels  were  established  on  the  basis  of  the  Total  SCAT  scores 
or  the  Verbal  SCAT  scores. 

There  was  no  evidence  to  indicate  that  interaction  was  stat¬ 
istically  significant  with  any  of  the  statistical  models  used. 

In  all  cases  a  comparison  of  the  means  between  the  two  treat¬ 
ment  groups  by  a  two-way  analysis  of  variance  indicated  no  signifi¬ 


cant  differences  at  the  0.01  level  of  confidence. 
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TABLE  XV 


STUDENT  QUESTIONNAIRE 


1.  WOULD  YOU  LIKE  TO  STUDY  ANOTHER  UNIT  USING  THIS 

METHOD  OF  INSTRUCTION?  YES  56% 

NO  44% 

2.  DID  YOU  FIND  THE  INSTRUCTIONS  EASY  TO  FOLLOW?  YES  81% 

NO  19% 


3.  DO  YOU  THINK  THIS  TYPE  OF  LEARNING  IS 

-  EASIER  THAN  LEARNING  IN  CLASS  FROM  A  TEACHER 

-  ABOUT  AS  EASY  AS  LEARNING  FROM  A  TEACHER 

-  MORE  DIFFICULT  THAN  LEARNING  FROM  A  TEACHER 


32%  /  u  l. 
38%  (chedf 
30%  °ne) 


4.  DO  YOU  THINK  LEARNING  IS 

-  QUICKER  THAN  LEARNING  IN  CLASS  FROM  A  TEACHER 

-  ABOUT  AS  QUICK 

-  SLOWER  THAN  LEARNING  IN  CLASS  FROM  A  TEACHER 


20% 

44% 

36% 


(check 

one) 


5.  (Check  only  one  for  each  statement) 


CONSIDERABLE 

ADVANTAGE 


SLIGHT  NO 
ADVANTe  AD VAN T. 


AN  INDIVIDUAL  CAN  WORK  AT  HIS 

OWN  PACE  57% 


THE  METHOD  CHECKS  TO  SEE  THAT 
EACH  POINT  IS  UNDERSTOOD  BEFORE 
PROCEEDING  TO  NEXT  POINT  57% 

AN  INDIVIDUAL  CAN  LEARN  FROM 

HIS  OWN  MISTAKES  WITHOUT  MAKING 

THEM  KNOWN  TO  THE  WHOLE  CLASS  18% 


THIS  METHOD  CANNOT  GIVE  EN¬ 
COURAGEMENT  LIKE  A  TEACHER  CAN  _ 3% 


PROGRESS  FROM  ONE  POINT  TO  NEXT 

IS  INTERRUPTED  BY  HAVING  TO 

ANSWER  QUESTIONS  20% 


AN  INDIVIDUAL  CANNOT  ASK  QUES¬ 
TIONS  ON  HIS  OWN 


35% 


22% 


42% 


16% 


18% 


8% 


21% 


40% 


81% 


57% 


2% 


18% 


80% 


: 
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CHAPTER  V 


SUMMARY,  CONCLUSIONS,  LIMITATIONS  AND  IMPLICATIONS 

I.  SUMMARY  OF  THE  EXPERIMENT 

Experimental  Procedures .  The  purpose  of  this  study  was  to  gather 
experimental  evidence  that  could  be  used  as  a  basis  for  evaluating 
the  relative  effectiveness  of  programmed  instruction  as  a  method  of 
teaching  logarithms.  The  experimental  population  consisted  of 
175  girls  registered  in  Mathematics  20.  In  class  groups  they  were 
randomly  assigned  to  one  of  two  treatments:  conventional  classroom 
method  of  teaching  or  the  method  of  programmed  instruction.  The 
topic  taught  to  both  groups  was  logarithms.  In  order  that  the 
effects  of  the  different  instructional  methods  on  students  of  dif¬ 
ferent  abilities  could  be  assessed,  the  experimental  group  was 
arbitrarily  categorized  into  two  levels,  first  on  the  basis  of 
scholastic  ability  (as  determined  by  Total  SCAT  scores)  into  HI  if 
the  score  was  71  or  more  and  LO  if  the  score  was  less,  and  secondly, 
on  the  basis  of  verbal  ability  (as  determined  by  Verbal  SCAT  scores) 
into  HI  if  the  stanine  score  was  7  or  more  and  LO  if  below  that. 

The  classes  assigned  to  the  conventional  method  of  teaching 
treatment  group  studied  the  prescribed  unit  on  logarithms  in  the 
authorized  text  under  the  direction  of  their  regular  mathematics 
teacher.  Exercises  and  homework  were  assigned  in  the  same  manner 
as  other  units  were  taught. 


. 


■n- 


- 


64 


The  other  classes  were  designated  as  the  programmed  instruction 
method  of  teaching  treatment  group.  These  classes  followed  the 
directions  accompanying  the  programmed  material  and  their  regular 
mathematics  teacher  supervised  only.  The  programmed  material  on 
logarithms  was  made  available  to  the  investigator  through  the  co¬ 
operation  of  the  Radar  Training  Centre  of  the  Royal  Canadian  Air 
Force.  This  group  was  offered  no  assistance  with  the  unit  nor  were 
they  permitted  to  take  the  material  out  of  the  classroom  and  it  was 
only  used  during  the  regular  mathematics  period.  Supplementary 
drill  exercises  were  available  to  this  group  to  use  if  time  per¬ 
mitted. 

During  the  spring  of  1965,  the  COOP  Intermediate  Algebra 
(Quadratics  and  Beyond)  Form  Y_  was  administered  to  the  experimental 
group  as  a  pre-test.  At  the  conclusion  of  the  treatments,  (two 
weeks  later) ,  Form  Z  of  the  same  test  was  administered  to  the  same 
group.  In  addition,  the  PROG  treatment  group  was  asked  to  complete 

a  questionnaire  in  regard  to  this  method  of  instruction. 

1  2 

Null  hypotheses  were  drafted  from  the  questions  which  the  study 

was  designed  to  answer.  The  acceptability  of  each  of  the  null  hy¬ 
potheses  was  tested  by  carrying  out  a  two-way  analysis  of  variance 
since  no  initial  significant  difference  in  the  two  treatment  groups 
was  found.  In  the  statistical  analysis  of  the  data,  the  difference 

^See  page  51. 

^See  page  3. 


. 


65 


between  mean  scores  was  considered  statistically  significant  only, 
if  the  probability  of  observing  such  a  difference  as  a  result  of 
sampling  error  was  0.01  or  less.  The  responses  to  the  questionnaire 
were  summarized  in  general  terms. 

Results  of  the  Statistical  Analyses .  The  statistical  analysis 
carried  out  on  the  data  in  the  experiment  led  to  the  following  results 

There  was  no  significant  difference  between  the  groups  in 
achievement  with  logarithms.  The  effect  of  interaction  was  not  stat¬ 
istically  significant.  The  students  in  level  HI  scores  significantly 
higher  than  the  students  in  level  L0. 

There  was  no  significant  difference  between  the  groups  in 
retention  of  logarithms.  The  effect  of  interaction  was  not  statisti¬ 
cally  significant.  The  students  in  level  HI  scored  significantly 
higher  than  students  in  level  LO. 

Findings  from  the  Student  Questionnaire .  Generally,  the  stu¬ 
dents  reacted  favorably  to  programmed  instruction  as  a  method  of 
teaching.  Many  thought  that  more  value  could  be  derived  if  a  teacher 
was  available  to  answer  questions  or  add  to  the  explanations  given 
in  the  material.  Most  students  did  complain  of  the  waste  of  time 
and  the  monotony  of  continually  turning  of  the  pages  of  the  booklet. 
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II.  CONCLUSIONS 

On  the  basis  of  the  results  of  the  statistical  analysis 
carried  out  and  within  the  limitations  of  this  study  and  in  con¬ 
sideration  of  the  student  responses  to  the  questionnaire,  the 
following  conclusions  could  be  framed: 

1.  Programmed  instruction  as  a  method  of  teaching  log¬ 
arithms  was  as  effective  as  the  conventional  method  of  teaching 
logarithms . 

2.  With  regard  to  achievement,  the  effectiveness  of  pro¬ 
grammed  material  in  teaching  logarithms  is  not  related  to  the 
students'  TOTAL  SCAT  scores  nor  VERBAL  SCAT  scores. 

3.  The  retention  of  the  learned  materials  did  not  differ 
significantly  for  either  treatment, 

4.  The  achievement  of  Level  HI  was  significantly  different 
from  the  achievement  of  Level  LO  in  both  treatments. 

5.  Students  regarded  the  programmed  instruction  method  as 
an  effective  method  of  instruction  but  expressed  concern  that 
boredom  could  set  in  if  this  method  of  instruction  was  continued 
for  a  long  period  of  time. 

6.  The  experiment  provided  validation  of  the  programmed 
booklets  as  a  method  of  instruction  for  the  materials  which  they 


cover. 


- 


67 


III.  LIMITATIONS 

The  foregoing  conclusions  must  be  considered  in  the  light  of 
the  following  limitations  of  the  study. 

These  conclusions  were  limited  in  their  interpretation  to 
the  population  of  Mathematics  20  students  in  the  Edmonton  Separate 
School  from  which  the  sample  was  drawn.  However,  no  attempt  was 
made  to  limit  the  sample  to  any  specific  section  of  the  city.  Another 
possible  limitation  was  the  short  period  of  time  involved  in  the  ex¬ 
perimentation.  If  a  longer  period  of  time  were  necessary,  the  results 
Could  have  been  different.  There  was  no  attempt  made  to  modify  the 
method  of  teaching  of  any  of  the  teachers.  They  were  urged  to  follow 
the  text  as  closely  as  possible. 

The  limitation  of  the  testing  instruments  should  be  consid¬ 
ered.  The  investigator  examined  the  available  standardized  tests. 

It  was  felt  that  the  COOP  Intermediate  Algebra.  (Quadratics  and 
Beyond)  included  more  questions  relating  to  logarithms  than  any  of 
the  other  tests  examined.  The  retention  test  was  taken  from  the 
school  library.  It  was  prepared  by  the  teachers  of  mathematics 
and  had  been  used  for  several  years.  The  teachers  concerned  felt 
it  would  represent  the  scope  of  logarithms  adequately. 

The  fact  that  the  SCAT  scores  used  were  taken  from  the  tests 
administered  to  the  students  two  years  prior  to  the  experiment  may 
be  a  limitation.  However,  it  was  felt  that  this  was  a  practical 
way  to  establish  a  scale  to  determine  possible  success  since  all  the 


■ 
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Grade  IX  population  of  Alberta  was  involved  and  that  these  scores 
were  made  available  to  the  high  schools  concerned  by  the  Department 
of  Education. 


IV.  IMPLICATIONS 

Socrates  is  credited  with  saying,  "Either  we  shall  find 

what  we  are  seeking,  or  at  least  we  shall  free  ourselves  of  the 

persuasion  that  we  know  what  we  do  not  know".  It  was  possibly  in 

3 

this  spirit  that  Nason  during  a  panel  discussion  on  the  challenge 
of  using  modern  media  in  instruction  at  the  Canadian  Education 
Association  convention  in  1964  stated  that  teacher  organizations 
should  concern  themselves  with  exploration  of  the  medium  of  pro¬ 
grammed  instruction  carefully  in  order  to  prevent  premature  com¬ 
mercial  exploitation  which  might  cause  educators  to  turn  away  from 
this  method  of  instruction  before  there  is  an  opportunity  to  develop 
and  utilize  its  potentialities  for  the  good  of  education. 

Among  the  possible  benefits  that  may  be  derived  from  pro¬ 
grammed  instruction  would  be: 

1)  increased  educational  opportunities;  for  example,  it  will 
allow  students  to  take  courses  which  they  might  otherwise 
miss  because  of  time-table  conflict; 

2)  provision  for  individual  needs  for  enrichment, 

3)  use  as  a  remedial  tool; 

3 

G.  Nason,  C^.  EL  A.  Newsletter  (Canadian  Education  Society, 
ed.  B.  Lowery,  December,  1964),  p.  6. 
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4)  use  for  drill  and  review; 

5)  use  in  teacher  training;  for  example,  programmed  instruc¬ 
tion  could  introduce  new  techniques  or  material  and  also 
make  teachers  more  aware  of  the  steps  involved  in  learning. 

One  of  the  aspects  of  programmed  instruction  which  would  bear 
investigation  is  the  concern  of  teachers  about  their  role.  Evidence 
offered  thus  far  does  not  bear  out  earlier  predictions  that  program¬ 
med  instruction  would  replace  teachers;  on  the  contrary  it  may  re¬ 
quire  more  teacher  participation.  The  teacher's  role  will  of  neces¬ 
sity  have  to  change.  The  key  to  this  changing  role  is  the  ease  with 
which  programmed  materials  allow  a  student  or  students  to  pursue  a 
specific  content  area  with  little  or  no  direction  from  the  teacher. 
The  effect  of  this  would  maximize  the  effectiveness  of  the  teacher 
by  freeing  him  from  the  routine  work  that  now  takes  up  so  much  of 
his  time  and  permit  more  time  to  pursue  the  demanding  work  of 
guiding  the  process  of  learning. 

Another  aspect  of  programmed  learning  that  bears  further 
investigation  is  to  determine  the  quality  of  available  programs. 
Unfortunately,  at  present  there  are  only  a  very  limited  number  of 
thoroughly  tested  high  quality  of  programs  available. 

Still  another  aspect  of  programmed  instruction  that  requires 
more  investigation  is  the  "retained  learning".  Insofar  as  this 
investigator  is  concerned,  no  significant  study  has  been  made  in 
this  regard.  How  would  students  taught  by  programmed  instruction 


. 
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compare  with  students  taught  in  the  conventional  classroom  method 
one  year  after?  two  years  later? 

More  attention  must  be  given  to  the  question  of  how  well 

"the  step  by  step"  technique  of  programmed  instruction  can  aid  in 

4 

concept  formation.  In  the  area  of  enrichment,  Bale  stresses  the 
lack  of  experimental  research. 

In  still  another  direction,  research  should  attempt  to  dis¬ 
cover  what  combination  of  teacher  and  programmed  instruction  yields 
the  most  effective  results.  Study  is  also  needed  to  consider  what 
kind  of  school  and  classroom  organizations  are  best  suited  to  these 
combinations  of  teacher  and  programmed  instruction. 

From  the  point  of  view  of  school  usage,  it  is  also  important 
to  investigate  variables  outside  the  program;  not  only  the  teacher's 
role  but  the  degree  of  administrative  support,  modifications  of 
classroom  structure,  and  procedures  for  coping  with  differences  in 
individual  rates  of  learning. 

The  results  of  such  studies  will  contribute  to  our  scanty 
knowledge  about  the  impact  of  programmed  instruction  on  the  class¬ 
room.  We  must  keep  in  mind  that  it  was  never  possible  for  an  ele¬ 
mentary  school  or  a  secondary  school  or  a  university  to  offer  all 
that  needs  to  be  learned,  but  in  the  pace  of  the  "explosion  of  know¬ 
ledge"  we  can  scarcely  delude  ourselves  any  longer.  The  problem  is 

^Chapter  II,  p.  30. 
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not  just  the  impossibility  of  absorbing  or  mastering  immense 
quantities  of  information,  but  that  much  of  the  knowledge,  the 
skill,  or  the  insights  are  possible  only  as  persons  mature. 
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APPENDIX 


SCORES  FOR  ALL  STUDENTS 


Beginning  on  the  following  page,  the  scores  obtained  by 
the  CON  group  (taught  logarithms  by  the  conventional  classroom 
method)  are  listed. 

The  symbols  heading  the  columns  are  to  be  interpreted 
as  follows: 


ID 

(Column  I) : 

Identification  Number 

PRE 

(Column  2) : 

Cooperative  Intermediate  Algebra  Test 
(Quadratics  and  Beyond)  Form  Y  (scaled) 
score. 

POST 

(Column  3) : 

Cooperative  Intermediate  Algebra  Test 
(Quadratics  and  Beyond)  Form  Z  (scaled) 
score . 

TOT 

(Column  4) : 

Total  SCAT  Ability  (percentile)  score 

VERB 

(Column  5) : 

Verbal  SCAT  (stanine)  score. 

RET 

(Column  6) : 

Logarithm  Retention  (raw)  score. 

■ 


ID 

001 

002 

003 

004 

005 

006 

007 

008 

009 

110 

012 

013 

014 

015 

016 

017 

018 

019 

020 

021 

022 

023 

024 

025 


80 

RET 

5 

6 

1 

7 

0 

5 

2 

6 

6 

5 

4 

7 

8 

6 

8 

8 

4 

6 

2 

4 

5 

3 

0 

2 


PRE 

POST 

TOT 

VERB 

62 

64 

95 

7 

56 

61 

43 

3 

55 

58 

62 

5 

59 

58 

38 

4 

51 

40 

25 

5 

50 

59 

64 

5 

60 

63 

72 

6 

62 

58 

45 

7 

55 

58 

64 

5 

53 

58 

75 

6 

60 

63 

50 

4 

66 

64 

92 

7 

63 

64 

75 

9 

52 

54 

42 

5 

66 

68 

92 

8 

62 

64 

76 

7 

52 

56 

54 

6. 

66 

64 

99 

9 

50 

53 

60 

6 

42 

53 

66 

5 

52 

55 

85 

7 

42 

55 

72 

7 

46 

51 

56 

5 

59 

60 

80 

6 

. 

ID 

026 

027 

028 

029 

030 

031 

032 

033 

034 

035 

036 

037 

038 

039 

040 

041 

042 

043 

044 

045 

046 

047 

048 

049 

050 


81 

RET 

3 

8 

3 

3 

0 

6 

1 

2 

1 

7 

3 

4 

1 

2 

3 

3 

3 

0 

5 

3 

1 

8 

5 

5 

4 


PRE 

POST 

TOT 

VERB 

60 

63 

99 

9 

58 

59 

80 

7 

49 

53 

43 

5 

46 

55 

92 

8 

38 

47 

21 

3 

56 

63 

93 

8 

51 

57 

64 

6 

60 

56 

66 

5 

51 

49 

54 

5 

55 

59 

84 

7 

48 

49 

54 

5 

52 

48 

78 

7 

53 

60 

58 

5 

54 

44 

56 

5 

57 

57 

82 

7 

57 

57 

82 

7 

57 

56 

85 

9 

58 

60 

87 

6 

53 

58 

84 

8 

50 

55 

76 

7 

49 

52 

60 

6 

60 

60 

89 

6 

48 

54 

41 

5 

47 

49 

26 

5 

57 

58 

49 

5 

. 

. 

ID 

051 

052 

053 

054 

055 

056 

057 

058 

059 

060 

061 

062 

063 

064 

065 

066 

067 

068 

069 

070 

071 

072 

073 

074 

075 


82 

RET 

6 

1 

4 

4 

6 

8 

7 

7 

3 

8 

4 

8 

8 

2 

6 

4 

8 

7 

4 

5 

4 

3 

1 

7 

3 


PRE 

POST 

TOT 

VERB 

53 

57 

70 

5 

39 

51 

79 

8 

49 

54 

52 

5 

47 

47 

42 

5 

62 

56 

87 

7 

53 

56 

68 

6 

57 

55 

74 

7 

61 

60 

34 

3 

55 

57 

80 

6 

62 

65 

85 

6 

60 

59 

62 

5 

60 

60 

78 

8 

58 

56 

49 

4 

53 

55 

68 

6 

58 

58 

72 

6 

61 

54 

88 

8 

59 

61 

78 

7 

62 

60 

65 

6 

57 

44 

62 

6 

60 

51 

60 

5 

54 

53 

56 

5 

52 

56 

84 

8 

48 

55 

40 

4 

48 

44 

51 

4 

55 

56 

47 

4 

83 


ID 

PRE 

POST 

TOT 

VERB 

RET 

076 

58 

50 

66 

7 

7 

077 

56 

63 

72 

7 

5 

078 

62 

59 

56 

5 

8 

079 

62 

57 

84 

8 

1 

080 

55 

59 

84 

8 

4 

081 

51 

49 

45 

6 

0 

082 

51 

59 

44 

3 

7 

083 

58 

60 

78 

6 

7 

084 

59 

63 

48 

5 

7 

085 

54 

58 

87 

7 

3 

086 

57 

58 

56 

6 

7 

087 

64 

63 

96 

8 

8 

088 

55 

59 

68 

6 

6 

089 

55 

58 

70 

5 

4 

090 

57 

49 

28 

3 

3 

091 

46 

49 

34 

5 

4 

092 

55 

57 

56 

5 

6 

093 

46 

53 

64 

6 

3 

094 

55 

56 

45 

4 

6 

095 

54 

61 

35 

3 

5 

096 

47 

52 

45 

5 

1 

Below,  the  scores 

obtained  by 

the  PROG  group 

(taught 

logarithms 

by  programmed  instruction)  are  listed: 


ID 

097 

098 

099 

100 

101 

102 

103 

104 

105 

106 

107 

108 

109 

110 

111 

112 

113 

114 

115 

116 

117 

118 

119 

120 


84 

RET 

3 

2 

3 

1 

2 

7 

1 

4 

4 

3 

2 

1 

6 

2 

5 

5 

6 

5 

1 

1 

6 

2 

1 

0 


PRE 

POST 

TOT 

VERB 

58 

58 

62 

5 

61 

63 

75 

5 

54 

56 

96 

9 

54 

56 

75 

7 

51 

60 

65 

7 

52 

53 

64 

6 

51 

54 

84 

6 

56 

55 

75 

7 

49 

47 

47 

5 

54 

56 

66 

5 

47 

56 

38 

4 

54 

55 

48 

4 

62 

63 

78 

6 

50 

50 

70 

5 

61 

62 

80 

5 

58 

59 

95 

5 

48 

55 

80 

7 

50 

58 

78 

7 

50 

52 

49 

6 

55 

61 

84 

4 

54 

55 

93 

7 

49 

57 

66 

6 

52 

56 

78 

5 

47 

48 

49 

5 

ID 

121 

122 

123 

124 

125 

126 

127 

128 

129 

130 

131 

132 

133 

134 

135 

136 

137 

138 

139 

140 

141 

142 

143 

144 

145 


85 

RET 

1 

6 

6 

5 

5 

7 

9 

3 

3 

8 

2 

9 

2 

7 

1 

7 

0 

7 

3 

0 

7 

9 

4 

3 

4 


PRE 

POST 

TOT 

VERB 

53 

58 

60 

5 

44 

54 

56 

5 

51 

60 

85 

6 

61 

64 

98 

9 

52 

58 

82 

7 

59 

60 

85 

6 

63 

60 

85 

7 

57 

52 

82 

7 

54 

56 

70 

6 

58 

58 

36 

4 

47 

50 

45 

4 

64 

63 

89 

7 

56 

54 

66 

5 

56 

57 

72 

6 

44 

52 

62 

9 

59 

60 

58 

5 

48 

52 

39 

4 

58 

54 

68 

6 

50 

47 

56 

3 

53 

50 

27 

2 

63 

66 

99 

9 

60 

60 

98 

8 

58 

56 

64 

5 

53 

56 

13 

3 

65 

65 

98 

9 

. 

ID 

146 

147 

148 

149 

150 

151 

152 

153 

154 

155 

156 

157 

158 

159 

160 

161 

162 

163 

164 

165 

166 

167 

168 

169 


86 

RET 

3 

4 

2 

8 

8 

3 

7 

1 

5 

7 

6 

5 

4 

2 

8 

4 

7 

1 

8 

8 

9 

6 

8 

6 


PRE 

POST 

TOT 

VERB 

57 

56 

60 

7 

60 

59 

97 

9 

61 

56 

78 

6 

58 

59 

85 

7 

60 

60 

97 

9 

58 

61 

60 

5 

66 

65 

97 

9 

54 

54 

61 

6 

51 

51 

64 

5 

58 

56 

49 

5 

53 

54 

72 

5 

61 

62 

60 

5 

48 

50 

84 

8 

62 

58 

51 

4 

58 

62 

98 

9 

61 

62 

93 

9 

56 

58 

85 

6 

55 

58 

75 

6 

56 

55 

72 

7 

60 

62 

96 

8 

61 

61 

98 

9 

58 

60 

92 

8 

57 

60 

87 

6 

54 

54 

95 

9 

ID 

PRE 

POST 

170 

66 

67 

171 

58 

59 

172 

61 

61 

173 

58 

57 

174 

63 

63 

175 

61 

64 

TOT 

VERB 

87 

RET 

99 

9 

9 

78 

5 

6 

97 

8 

9 

82 

6 

2 

97 

7 

2 

99 

9 

8 

88 


CHI  SQUARE  TEST  ON  CELL  FREQUENCIES 
(Adaptation  from  Ferguson,  p.  169  Table,  p.  309) 

BASED  ON  TOTAL  SCAT  SCORE: 


X  = 


HI 

LO 

CON 

40 

56 

96 

PROG 

32 

47 

79 

72 

103 

175 

175(32*56  -  40*47)2 

79*96*72*103 

0.03  (not  significant) 

,  SCAT  SCORE: 

HI 

LO 

CON 

34 

62 

96 

PROG 

34 

45 

79 

68 

107 

175 

175(34*62  -  34*45)2 

96*79*68*107 

=  1.06  (not  significant) 


df  = 


X2_10(df  1)  =  2.71 
X2  01(df  1)  =  6.64 


1 
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B29884 


